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SECTION  I 


INTRODUCTION 


★ 

1.  Introduction 

Various  facets  of  analog-digital-analog  (A-D-A)  systems  have  been 
studied  by  researchers  over  the  past  four  decades.  These  research  efforts  have 
generally  followed  two  distinct  lines  of  interest.  The  first  is  the  theoretical 
approach  where  the  mathematicians  have  demons t"ated  the  analytical  feasibility 
of  various  A-D-A  system  data  processing  techniques.  While  they  have  derived  a 
variety  of  computational  formulas,  optimization  techniques,  and  bounds  on  per- 
formance, there  has  generally  been  much  discrepancy  between  their  results  and  the 
performance  actually  obtained  from  hardware  systems.  This  is  probably  due  to  the 
mathematicians  lack  of  interest  in  the  hardware  realization  problem  and  hence 
their  unawareness  of  many  of  the  actual  hardware  constraints  and  performance 
limiting  errors  in  A-D-A  systems. 

The  other  line  of  interest  is  the  hardware  realization  problem  where 
design  engineers  have  studied  the  actual  errors  in  A-D-A  systems.  However,  their 
lack  of  interest  in  mathematics  has  often  impaired  their  ability  to  formulate 
good  statistical  models  for  these  errors.  As  a result,  design  engineers  have 
often  been  limited  to  following  heuristic  trial-by-error  approaches  which  often 
result  in  over-designed  systems  that  are  wasteful  of  both  bandwidth  and  money. 

In  his  research,  Holland  has  attempted  to  close  the  gap  between 
the  mathematical  theories  for  A-D-A  systems  and  the  hardware  realization  problem. 

He  has  tried  to  generalize  and  unify  all  of  the  existing  analytical  theories  for 

★ . . 

Portions  of  this  material  are  reprinted  here  with  permission  from:  J.F.  Holland, 
Statistical  Analysis  of  Analog-Digital-Analog  Systems,  Ph.D.  dissertation,  Stanford 
University,  March  1974. 


these  systems  while  avoiding  assumptions  which  are  inconsistent  with  the  hard- 
ware realization  problem.  A method  is  given  by  which  the  actual  errors  in 
sophisticated  A-D-A  systems  can  be  jointly  modeled,  studied,  and  design  trade- 
offs made  in  order  to  mir'mize  the  power  spectrum  of  the  error.  The  method  has  =. 

been  shown  to  agree  within  tenths  of  a dB  with  measurements  taken  on  many  actual 
high  speed  A-D-A  systems. 

In  his  work  a variety  of  new  first  and  second  order  multi- 
dimensional sampling  theorems  are  given  for  nonstationary  processes.  Both 
bandlimited  and  non-bandlimited  processes  are  considered  as  well  as  the  impact  of 
aliasing  error.  These  theorems  are  then  generalized  to  include  the  effects  of 
read-in,  read-out  and  locked  timing  jitter.  New  modeling  results  for  track  and 
hold  amplifiers  are  also  presented  with  a simplified  Fokker-Planck  method  of 
evaluating  the  joint  probability  density  function  for  nonlinear  systems  with 
memory  and  driven  by  Gaussian  colored  noise. 

New  results  are  given  in  his  dissertation  for  the  second  order 
statistics  of  the  output  and  error  processes  arising  from  arbitrary  quantizers 
with  multidimensionally  sampled  nonstationary  input  processes  having  arbitrary 
amplitude  statistics.  All  previous  results  are  shown  to  be  special  cases  of  his 
results.  The  effect  of  A/D  and  D/A  level  errors  is  included  in  the  analysis. 

These  results  are  then  generalized  to  include  the  effect  of  symbol  errors  arising 
from  arbitrary  channels. 

The  equations  are  formulated  so  that  the  input  signal  dependent 
error  noise  spectrum  at  the  A-D-A  system  output  can  be  studied.  The  approach  allows 
the  system  designer  to  determine  which  errors  are  significantly  limiting  performance. 

The  generality  of  this  analysis  is  consistent  with  recent  psychophysical  testing 
results  for  picture  images.  Extensions  to  data  compression  techniques  such  as 
differential  PCM  are  also  considered. 
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Requirement  for  A-D-A  System  Design  Curves 

Speech,  image,  and  other  signals  obtained  from  sensors  and  trans- 
ducers are  generally  in  analog  form.  Likewise,  most  of  the  signals  that  control 
electromechanical  devices  are  also  in  analog  form.  However,  the  process’ 
analog  signals  has  many  limitations  such  as  poor  resolution  due  to  the  pr 
noise,  problems  with  analog  multipliers,  and  difficulties  with  synchronization. 

Also,  the  accuracy  of  analog  processed  signals  becomes  degraded  after  every  operation. 
Consequently,  with  the  decreasing  cost  of  digital  hardware,  there  is  a growing 
interest  in  digital  processing. 

Digital  techniques  offer  the  advantages  of  increased  accuracy, 
effective  noise  minimization,  and  better  processing,  transmission,  and  storage  of 
data.  Unlike  analog  processing,  accuracy  is  not  degraded  after  every  operation, 
but  rather  remains  a constant.  In  addition,  digital  processing  mad  s feasible 
the  application  of  adaptive  noncausal  precision  operations  such  os  the  filtering 
of  data.  Finally,  digital  processing  is  almost  fundamental  to  the  concept  of 
data  compression  and  the  efficient  communication  of  information. 

The  unique  advantages  of  digital  control,  computation,  and  com- 
munication have  found  application  in  practically  every  field:  process  control, 
simulation,  navigation,  telemetry,  traffic  control,  measuring  and  recording 
instrumentation,  displays,  commerical  and  military  aerospace  systems,  ground  and 
satellite  communication  systems  — the  list  seems  endless.  However,  the  success 
of  any  application  depends  on  how  well  the  digital  processor  is  interfaced  with 
the  analog  world.  It  is  the  practical  limitations  and  statistical  characteristics 
of  this  interface  that  are  the  focuses  of  this  research. 

•ff 

Portions  of  this  material  are  reprinted  here  with  permission  from:  J.F.  Holland, 
Statistical  Analysis  of  Analog-Digital-Analog  Systems,  Ph.D.  dissertation,  Stanford 
University,  March  1974. 
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While  the  literature  contains  hundreds  of  analyses  and  optimization 


r 

schemes  for  analog-digital-analog  (A-D-A)  systems,  all  have  ignored  one  or  more 
of  the  fundamental  error  sources  in  such  systems.  The  most  common  omission  is 
aliasing  (spectral  folding)  error  arising  from  sampling,  which  can  result  in  a 
20  dB  discrepancy  between  rate  distortion  theory  bounds  and  actual  measured  per- 
formance. Another  common  omission  is  the  effect  of  level  errors  which  in  high 
speed  systems  may  result  in  a 12  dB  loss  in  dynamic  range  (2  bits)  from  theoretical. 
In  addition,  many  of  the  available  papers  contain  other  unfounded  assumptions 

' 

which  give  rise  to  performance  predictions  which  are  in  total  disagreement  with 
experiment . 

Holland's  approach,  though  very  mathematical,  deals  with  the  com- 
bined effect  of  the  actual  errors  in  A-D-A  systems  and  their  impact  on  system 
performance.  The  equations  are  formulated  so  that  the  input  analog  signal  dependent 
A-D-A  interface  and  transmission  errors  can  be  studied  and  design  trade-offs  made 
between  the  various  error  sources.  This  report  is  a companion  volume  to  the 
Statistical  Analysis  of  Analog-Digital-Analog  Systems.  It  provides  dozens  of 
design  curves  which  allow  the  design  engineer  to  analyze,  specify,  and  predict 
the  performance  of  A-D-A  systems  without  a strong  mathematical  background. 
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3.  The  Concept  of  A-D-A  Svstem  Analysis  and  Optimization 

In  order  to  motivate  the  problem  further,  consider  the  example 
A-D-A  system  in  Figure  1-1.  It  consists  of  an  analog-to-digital  (A/D)  converter 
and  a digital-to-analog  (D/A)  converter.  Suppose  the  hardware  is  over-designed 
so  that  quantization  error  and  aliasing  (spectral  folding)  error  are  the  only 
significant  sources  of  error  in  the  system.  Define  the  input  analog  signal  to 
be  Gaussian  white  noise  passed  through  an  Nth  order  Sutterworth  filter.  Let  us 
examine  how  well  the  input  signal  is  reproduced  at  the  output  as  a function  of 
the  sampling  rate,  the  number  of  quantization  levels,  and  the  order  of  the 
Butterworth  filter. 


INPUT 

analog_ 

A/O 

oigital 

D/a 

signal 

CONVERTER 

signal 

converter 

OUTPUT 

analog 


signal 


Figure  1-1.  Example  A-D-A  System 

Our  first  result  is  shown  in  Figure  1-2  where  we  have  computed 
signal-to-noise  ratio  (SNR),  the  noise  being  due  to  aliasing  error  only.  This 
curve  shows  that  when  a 60  pole  Butterworth-f iltered  white  noise  process  is 
Nyquist  sampled  at  twice  the  3 dB  nominal  bandwidth,  the  SNR  after  sampling  is 
only  25  dB.  Hence,  bandlimiting  filters  are  not  easily  approximated  and  over- 
sampling  is  the  only  reasonable  way  to  drop  the  aliasing  error  to  a tolerable 
level.  Some  manufacturers  make  it  a practice  to  over-sample  as  much  as  five  times 
the  nominal  3 dB  bandwidth  Nyquist  rate,  then  struggle  to  stay  within  channel 
bandwidth . 

★ , , , , , 

Portions  of  this  material  are  reprinted  here  with  permission  from:  J.F.  Holland, 

Statistical  Analysis  of  Analog-Digital-Analog  Systems,  Ph.D.  dissertation,  Stanford 
University,  March  1974. 
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Figure  1-2.  SNR  Vs.  Butterworth  Spectrum  Order  for  Gaussian  Input  and 
Sampling  at  Twice  the  3 dB  Frequency.  Noise  is  Due  to 
Aliasing  Error  Only. 


power  in  a narrow  frequency  slot  of  the  data  band  is  good  at  low  frequencies  and 
poor  at  high  frequencies.  This  phenomenon  is  shown  in  the  typical  set  of  curves 
in  Figure  1-3  where  the  signal-to-noise  power  spectrum  ratio  (SNSR)  is  plotted 
versus  frequency  normalized  to  the  data  band  for  32  quantization  levels.  Observe 
that  for  sampling  at  the  Nyquist  rate  of  2.0  times  the  input  3 dB  frequency,  the 
SNSR  varies  by  22  dB  over  the  data  band.  For  an  input  signal  consisting  of  many 
frequency  multiplexed  channels,  this  variation  obviously  cannot  be  tolerated. 
However,  there  is  considerable  improvement  for  sampling  at  2.8  times  the  signal 
bandwidth  since  the  SNSR  varies  by  only  6 dB. 

Suppose  we  require  a minimum  of  20  dB  SNSR  over  the  data  band.  At 
what  frequency  should  we  sample?  We  expect  that  tie  required  sampling  rate  will 
decrease  as  the  order  of  the  Butterworth  spectrum  increases,  but  increasing  the 
filter  order  also  increases  the  phase  distortion.  Figure  1-4  gives  a set  of  curves 
for  determining  the  optimum  sampling  frequency.  The  intersection  of  these  curves 
and  the  dashed  line  is  the  optimum  sampling  rate.  For  a fourth  order  filter,  3.0 
is  best  since  any  lower  sampling  rate  will  not  yield  a 20  dB  SNSR  over  the  entire 
data  band  and  any  higher  sampling  rate  will  waste  channel  bandwidth.  Similarly, 

2.4  is  best  for  a ten  pole  filter  and  3.7  for  a three  pole  filter. 

In  Figures  1-5  and  1-6  the  same  phenomenon  is  shown  as  a function  of 
the  order  of  the  Butterworth  spectrum  with  the  sampling  frequency  fixed  at  2.0  and 
2.8  times  the  highest  baseband  frequency.  While  the  SNSR  at  low  frequencies  is 
mostly  determined  by  the  number  of  quantization  levels,  that  at  higher  frequencies 
is  again  dominated  by  aliasing  error.  In  terms  of  effective  3 dB  bandwidths,  the 
bandwidths  of  the  recovered  signals  are  37  and  88  percent  of  the  bandwidth  of  the 
input  signal  as  shown  by  the  dashed  lines.  Hence,  by  increasing  the  sampling  rate 
by  a factor  of  1.4  the  effective  bandwidth  of  the  recovered  signal  is  increased  by 
a factor  of  88/37  = 2.4. 
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NORMALIZED  SAMPLING  FREQUENCY 


Figure  1-4.  Normalized  SNSR^.^  = 20  dB  3andwidth  Vs. 

Sampling  Rate  for  a Buttervorth  Input 
Signal  Spectrum  With  Gaussian  Amplitude 
Statistics.  Number  of  Quantization  Levels  = 32. 
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ORDER  OF  BUTTERWORTH  SPECTRUM 


Figure  1-5.  SNSR  Vs.  Frequency  in  Data  Band.  Sampling  at  Twice  the  Highest 
Baseband  Frequency.  Number  of  Quantization  Levels  = 32. 


I 


We  also  expect  SNSR  to  vary  greatly  with  the  number  of  quantization 
levels.  This  variation  is  shown  in  Figures  1-7  and  1-8  where  SNSR  is  plotted  for 


2 and  10  bits,  respectively. 

From  this  simple  example,  we  conclude  there  are  many  design  trade- 
offs to  be  made  in  A-D-A  systems.  While  here  we  have  only  considered  two  error 
sources,  there  are  many  more  in  practical  systems.  Since  each  of  these  error 
sources  produce  noise  in  the  output  analog  signal  which  is  dependent  not  only  on 
the  A-D-A  system  parameters,  but  also  on  the  input  analog  signal,  the  analysis 
and  optimization  of  such  systems  is  difficult. 

4.  Preview  of  Results 

' 1 The  purpose  of  this  design  manual  is  to  present  curves  which  allow 
the  design  engineer  to  evaluate  the  performance  of  an  A-D-A  system.  Section  2 
gives  an  overview  of  A-D-A  system  analysis  and  experimental  methods  for  measuring 
performance.  Quantization  design  curves  are  then  given  in  Sections  3 and  4 for 
linearly  and  logarithmically  companded  quantizers.  Aliasing  error  design  curves 
are  given  in  Section  5 ''for  Butterworth  and  Chebyshev  spectrums.  The  effect  of 
dither  signals  is  examined,  in  Section  6. 


SNSR  (JB) 


I 


normalized  frequency 


Figure  1-8.  SNSR  Vs.  Frequency  in  Data  Band.  5th  Order  Butterworth 

Input  Signal  Spectrum  With  Gaussian  Amplitude  Statistics. 
Number  of  Quantization  Levels  = 1024  (10  bits). 
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SECTION  II 


ANALYSIS  OF  A-D-A  SYSTEMS 


1.  Introduction 

The  various  components  which  comprise  an  A-D-A  system  have  been 
rigorously  analyzed  in  the  Statistical  Analysis  of  Analog-Digital-analog 
Systems . Included  in  these  analyses  are  detailed  discussions  of  the  various  error 
sources  associated  with  each  component: 

• Sampler 

1)  Aliasing  error 

2)  Slew  rate  error 

3)  Aperture  error 

4)  Read-in  sampling  jitter 

• PCM  or  DPCM  encoder 

1)  Quantizing  error 

2)  A/D  level  error 

• Modulator-channel-demodulator 
1)  Transmission  (symbol)  error 

• D/A  converter 

1)  D/A  level  error 

2)  Read-out  sampling  jitter 

3)  Reconstruction  filter  error 

• Thermal  noise  from  each  component  in  high  performance 
low  power  systems. 

This  section  gives  an  overview  of  modeling  these  errors  and  experimentally  measuring 
the  performance  of  A-D-A  systems.  More  detail  and  experimental  verification  of  the 
modeling  approach  are  given  in  the  Statistical  Analysis  of  Analog-Digital-Analog 
Systems . 
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2.  Statistical  Analysis  of  A-D-A  Systems 

Consider  the  example  telecommunications  system  shown  in  Figure  2-1. 
It  consists  of  a track  and  hold  amplifier,  a quantizer,  a channel,  and  D/A  sub- 
system. The  track  and  hold  amplifier  is  a bistable  device  controlled  by  timing 
logic.  In  the  track  mode  the  storage  capacitor  voltage  follows  the  input  voltage 
within  the  limitations  of  the  available  charging  current.  This  limitation  on 
charging  current  gives  rise  to  a slew  rate  error.  During  the  hold  mode  the 
capacitor  is  isolated  from  the  input  and  its  voltage  remains  essentially  constant. 
However,  depending  on  the  design  of  the  sampling  switch,  an  input  signal  dependent 
discharge  of  the  capacitor  may  occur  during  switching  from  the  track  to  hold  states 
which  gives  rise  to  an  aperture  error.  Finally,  phase  instabilities  in  the  clock 
may  result  in  irregularities  in  the  track  and  hold  periods  resulting  in  read-in 
timing  jitter. 

The  quantizer  encodes  the  analog  output  of  the  track  and  hold 
amplifier  into  a digital  word  during  the  hold  period.  This  encoding  is  implemented 
by  a successive  approximation  algorithm.  At  each  step  of  the  approximation  a 
binary  decision  is  made  and  then  fed  back  to  the  comparator  through  a D/A  converter 
to  prepare  for  the  next  step  of  the  approximation.  The  collection  of  these  binary 
decisions  forms  the  output  digital  word.  The  successive  approximation  algorithm 
can  be  extended  to  the  encoding  of  three  bits  at  each  step,  but  requires  seven 
comparators . 

This  encoding  of  the  anlog  output  of  the  track  and  hold  amplifier 
results  in  quantization  error.  In  addition,  imperfections  in  the  equipment  give 
rise  to  level  errors  which  cause  errors  in  the  encoding.  These  level  errors  occur 
in  two  ways : 

★ , , ... 

Portions  of  this  material  are  reprinted  here  with  permission  from:  J.F.  Holland, 

Statistical  Analysis  of  Analog-Digital-Analog  Systems,  Ph.D.  dissertation,  Stanford 
University,  March  1974. 
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• A/D  level  errors 

• A/D/A  level  errors 

The  first  is  associated  with  the  comparator  decision  threshold  level  and  results 
in  an  A/D  level  error.  Through  careful  analysis  it  can  be  shown  that  this  kind 
of  level  error  results  in  a noise  which  is  highly  correlated  with  the  signal  being 
encoded,  which  distinguishes  it  from  A/D/A  level  errors.  This  second  kind  of  level 
error  results  from  inaccuracies  in  the  D/A  converter  due  to  resistor  tolerances  and 
settling  times.  It  can  be  shown  that  D/A,  thus  A/D/A  level  errors,  are  uncorrelated 
with  the  signal  and  therefore  may  be  represented  as  an  additive  noise.  While  one 
might  conjecture  the  equivalence  of  these  two  level  errors  on  the  basis  that  they 
both  produce  level  offsets,  this  heuristic  equivalence  argument  breaks  down  in 
the  rigorous  analysis  of  these  errors.  Observe  that  the  effect  of  an  A/D  level 
error  in  an  A/D  converter  with  only  one  comparator  is  to  add  a constant  voltage  to 
the  signal  before  encoding.  When  more  than  one  comparator  is  used,  the  effect  is 
more  complex. 

The  channel  produces  transmission  errors  in  the  digital  signal 
received  by  the  D/A  subsystem.  From  the  received  digital  signal  the  D/A  converter 
reconstructs  the  analog  signal.  Irregularities  in  synchronization  result  in 
read-out  timing  jitter.  Also,  there  will  be  inaccuracies  in  the  D/A  converter 
used  for  reconstructing  at  the  output.  Observe  that  the  time  domain  transients 
of  the  quantizer  D/A  converter  were  gated  out  by  the  D/A  control  logic.  Hence, 
they  only  resulted  in  A/D/A  level  errors.  In  order  to  prevent  these  transients 
from  corrupting  the  reconstructed  analog  signal,  the  output  D/A  converter  is  often 
followed  by  another  track  and  hold  amplifier  (deglitcher) . This  amplifier  gates 
out  the  transients  30  that  their  only  effect  is  to  produce  additional  level  errors 
known  as  D/A  level  errors.  We  specify  deglitching  and  do  not  model  the  output 
D/A  converter  transients. 
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From  the  preceding  discussion  it  is  clear  that  our  example  A-D-A 
system  contains  many  error  sources.  In  its  present  form  this  system  is  far  too 
complex  to  rigorously  analyze.  The  track  and  hold  amplifier  alone  constitutes 
a challenging  analysis  for  any  of  the  available  network  analysis  programs.  However, 
the  A-D-A  system  modeling  approach  developed  in  this  section  will  allow  us  to 
examine  trade-offs  between  the  many  system  errors  and  locate  the  dominant  ones. 

Consider  the  general  A-D-A  system  shown  in  Figure  2-2  of  which 
the  system  in  Figure  2-1  is  a special  case.  It  has  been  broken  down  into  an  A/D, 
a channel,  and  a D/A  subsystem.  Each  subsystem  introduces  errors  into  the  output 
analog  signal.  In  some  cases  the  names  of  the  blocks  have  deliberately  been 
chosen  unconventionally,  in  an  effort  to  be  more  definitive  as  to  the  function 
of  the  blocks  and  the  nature  of  their  errors.  In  order  to  identify  these  error 
sources  and  ascertain  the  degree  to  which  they  degrade  performance,  we  now  derive 
an  equivalent  A-D-A  system  which  contains  mathematically  analyzable  hardware, 
but  retains  the  salient  error  sources  of  the  original  system. 

The  first  step  is  to  replace  the  actual  channel  subsystem  by  one 
which  is  mathematically  tractable.  The  fact  that  this  is  possible  follows  from 
several  observations.  The  first  is  that-  the  digital  signals  entering  and  leaving 
possibly  for  some  kind  of  timing  jitter.  This  synchronization  is  generally  per- 
formed by  clocks  and  digital  logic.  The  second  observation  is  that  a digital 
signal  may  only  take  on  discrete  values.  Hence,  regardless  of  what  modulator, 
channel,  and  demodulator  comprises  the  channel  subsystem,  the  only  external  effect 
of  this  subsystem  is  to  introduce  errors  in  the  digital  signal  at  the  output. 

Thus,  we  may  replace  the  channel  subsystem  by  a discrete  noisy  channel  which  in 
general  is  neither  memoryless  nor  time  invariant. 

Our  third  observation  is  that  telecommunications  systems  operating 
over  fading  channels,  burst  error  channels,  or  noisy  channels  with  strong  inter- 
ference are  generally  designed  to  compensate  for  the  deficiencies  of  the  channel. 
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Temporal  diversity,  frequency  diversity,  spacial  diversity,  channel  coding, 
and  choice  of  modulation  format  are  some  of  the  standard  techniques.  Con- 
sequently, in  many,  if  not  most  applications,  an  adequate  model  for  the  channel 
subsystem  is  a discrete  memoryless  time  invariant  noisy  channel  where  the 
transition  probabilities  are  derived  from  the  channel  subsystem  taking  into 
account  the  effect  of  encoding.  The  result  is  the  simplified  A-D-A  system  model 
shown  in  Figure  2-3. 

Our  new  A-D-A  system  model  can  be  simplified  even  further.  Observe 
that  the  sampler  provides  the  quantizer  with  a constant  voltage  over  each  hold 
period.  At  the  end  of  this  hold  period  it  is  assumed  that  the  quantizer  circuitry 
has  reached  steady  state  and  the  quantizer  output  is  then  gated  through  logic 
circuitry  (sampled)  into  the  digital  word  generator.  The  output  of  the  digital 
word  generator  is  then  gated  through  the  channel  and  into  the  digital  word  detector 
by  means  of  various  synchronization  clocks.  The  digital  word  detector  in  turn 
controls  the  signal  level  generator  which  synchronously  pulses  the  reconstruction 
filter.  The  final  output  analog  signal  is  then  obtained  at  the  output  of  the 
reconstruction  filter.  Hence,  sampling  and  resampling  occurs  throughout  the 
entire  A-D-A  system  to  compensate  for  the  physical  time  constants  of  the  hardware. 

For  analysis  purposes,  it  suffices  to  replace  much  of  the  A-D-A 
system  hardware  of  our  model  with  memoryless  hardware  which  makes  the  same  errors. 
Remembering  that  memoryless  devices  commute  with  impulse  sampling,  we  can  then 
collapse  our  system  model  into  one  which  is  tractable  for  analysis  but  still  contains 
the  salient  error  sources  of  the  original  system.  In  the  resulting  system  model 
the  continuous  time  quantizer  and  channel  are  memoryless,  and  the  effect  of 
sampling  is  modeled  by  three  devices  distributed  over  the  A-D-A  system,  as  shown 
in  Figure  2-4. 


Figure  2-3.  Simplified  A-D-A  System  Model 


The  sample  and  hold  block  models  the  non-memoryless  nonlinear 
distortion  occuring  in  samplers.  For  example,  this  is  where  we  model  the 
deleterious  effects  of  slew  rate  and  aperture  error  associated  with  high  speed 
track  and  hold  amplifiers.  Since  non-memoryless  nonlinear  devices  do  not 
commute  with  any  other  portion  of  our  A-D-A  system  model,  the  sample  and  hold 
block  must  be  placed  ahead  of  the  memoryless  quantizer.  The  memoryless  quantizer 
block  models  the  effect  of  quantizing  a signal.  In  addition,  it  models  the  A/D 
and  A/D/A  level  errors  associated  with  quantization  and  the  D/A  level  errors 
associated  with  the  analog  signal  level  generator. 

In  A-D-A  systems  using  a large  number  of  levels,  the  A/D/A  level 
error  noise  power  is  much  less  than  that  of  the  signal.  Consequently,  this  noise 
will  have  negligible  effect  on  the  quantization  noise  and  that  of  the  A/D  and 
D/A  level  errors.  Thus,  the  A/D/A  level  error  noise  measured  at  the  reconstruction 
filter  will  appear  to  be  additional  D/A  level  error  noise.  Since  these  D/A 
and  A/D/A  level  error  noises  have  the  same  form  of  covariance  function  and  are 
uncorrelated,  they  may  be  added  together.  This  aggregate  noise  is  then  modeled 
by  the  memoryless  quantizer  block. 

The  impulse  sampler,  which  commutes  with  both  the  memoryless  channel 
and  the  memoryless  quantizer,  models  performance  degradation  due  to  aliasing. 

Observe  that  every  error  process  in  an  A-D-A  system  is  sampled  prior  to  the  re- 
construction filter.  Hence,  not  only  does  the  signal  arriving  at  the  reconstruction 
filter  contain  noise  plus  aliasing  error  due  to  the  input  signal,  but  it  also 
contains  additional  noise  due  to  the  aliasing  of  the  noise  processes  and  all  of 
the  crosscorrelation  spectra  between  the  signal  and  the  various  noises. 

The  impulse  sampler  also  models  several  types  of  jitter.  The  first 
is  read-in  jitter,  the  departure  from  intended  sampling  times  in  sampling  the  analog 
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input  process.  The  second  in  read-out  jitter,  the  departure  from  the  intended 
pulsing  times  of  the  analog  signal  level  generator  which  drives  the  reconstruction 
filter.  When  these  two  operations  (sampling  and  pulsing)  are  performed  by 
different  pieces  of  hardware,  the  jitters  may  usually  be  assumed  statistically 
independent.  In  this  case  the  read-out  jitter  may  be  due  to  poor  synchronization. 
However,  when  the  same  clock  is  used  to  time  both  operations,  the  jitters  will 
usually  be  identically  equal.  In  these  applications  the  two  jitters  are  called 
lock  jitter. 

The  last  block  in  our  A-D-A  system  model  is  the  reconstruction 
filter,  which  is  generally  not  the  same  reconstruction  filter  as  in  the  original 
system.  Two  standard  types  of  signal  level  generators  are  ones  whose  output 
simulates  that  of  an  impulse  sampler  and  ones  whose  output  approximates  that  of 
an  impulse  sampler  cascaded  with  a zero  order  hold  filter.  When  the  second  type 
of  signal  level  generator  is  used,  the  reconstruction  filter  it  pulses  in  the 
actual  system  may  be  regarded  as  the  cascade  of  two  filters.  The  first  is  an 
equalization  filter  which  is  designed  to  have  an  approximate  inverse  zero  order 
hold  frequency  response.  The  output  of  this  equalization  filter  will  then  be 
approximately  the  same  as  the  output  signal  of  the  first  type  of  signal  level 
generator.  The  filter  following  the  equalization  filter  is  then  the  same  filter 
as  the  reconstruction  filter  that  would  be  used  in  conjunction  with  the  first 
type  of  signal  level  generator. 

In  the  first  case  where  the  signal  level  generator  approximates  an 
impulse  sampler,  at  best  we  can  choose  the  reconstruction  filter  to  pass  what  is 
in  the  data  band  and  to  block  what  is  no't  in  the  data  band.  Since  realizable 
filters  never  completely  block  the  noise  outside  the  data  band,  a reconstruction 
error  occurs.  This  may  be  included  in  our  A-D-A  system  model  by  using  the  actual 
reconstruction  filter  (the  filter  following  the  equalization  filter  for  the  second 
case)  in  our  model. 
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Hence,  the  A-D-A  system  model  given  in  Figure  2-4  contains  all  of 
the  dominant  error  sources  of  the  original  A-D-A  system  in  Figure  2-2,  and  thus, 
those  in  Figure  2-1.  By  dynamically  measuring  the  level  errors  associated  with 
the  quantizer  and  the  signal  level  generator,  even  settling  times  will  be 
incorporated  in  the  model.  Should  thermal  noise  in  some  portion  of  the  original 
system  become  a significant  factor,  it  is  easily  modeled  by  introducing  an  in- 
dependent additive  noise  source  at  the  appropriate  place  of  the  model  in 
Figure  2-4. 
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3.  Choice  of  Performance  Criterion. 

There  are  a variety  of  performance  measures  used  to  evaluate 
A-D-A  systems.  Probably  the  most  commonly  used  measure  is  mean  square  error. 

Its  choice  generally  stems  more  from  mathematical  tractability  than  its 
relationship  to  an  observers  concept  of  quality.  In  fact,  it  is  fairly  easy 
to  juggle  the  spectrum  of  a signal  in  speech  and  picture  processing  such  as  to 
obtain  two  reproductions  of  the  original  signal,  the  best  sounding  (looking) 
one  having  the  largest  mean  square  error.  This  result  follows  from  one  very 
simple  observation.  Consider  the  system  shown  in  Figure  2-5.  The  power  spectrum 
of  the  error  is  given  by 


S__(u)  = S (u) 

yy 


S (oj)  + s _(u)  + S.  (a) 

xx  x£  5x 


(2-1) 


while  S„_(uj),  S (oj),  and  S (w)  must  be  non-negative  for  all  m,  S _(io)  and 
4 5 yy  xx  ° xC 

S„x(w)  are  not  non-negative.  Now  the  mean  square  error  is  the  area  under  the 
S (u>)  curve.  Thus,  we  can  choose  the  system  to  produce  a fairly  small  mean  square 
error  while  keeping  S^_(u)  quite  large  for  some  frequencies.  Consequently,  mean 
square  error  is  often  a very  poor  performance  measure  when  the  noise  is  signal 
dependent  and  arises  from  nonlinearities  and  aliasing. 
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Figure  2-5.  Performance  Measurement  Diagram 


Portions  of  this  material  are  reprinted  here  with  permission  from:  J.F.  Holland, 
Statistical  Analysis  of  Analog-Digital-Analog  Systems,  Ph.D.  dissertation,  Stanford 
University,  March  1974. 


2-13 


From  our  discussion  in  the  previous  section,  we  may  conclude  that 


the  performance  of  an  A-D-A  system  is  essentially  determined  ahead  of  the 
reconstruction  filter.  This  follows  from  the  fact  that  once  the  signal  and 
A-D-A  system  noises  have  been  sampled,  thus  aliased,  there  is  no  way  of  unscramb- 
ling the  spectrum.  Furthermore,  depending  on  the  choice  of  system  parameters, 
the  resulting  noise  power  in  the  data  band  may  vary  with  frequency  by  as  much 
as  60  dB.  Hence,  a good  performance  measure  must  provide  information  on  the 
frequency  distribution  of  the  noise  relative  to  the  signal  over  the  data  band. 
Finally,  the  effect  of  the  crosscorrelation  spectra  must  not  be  ignored. 


SNSR  (u)  = 


Our  performance  criterion, 
^xx(u) 


V“> 


(2-2) 


the  ratio  of  the  signal  and  noise  power  spectrums  over  the  data  band,  has  all  of 
these  advantages.  In  addition,  it  is  essentially  independent  of  the  choice  of 
reconstruction  filter,  consistent  with  our  view  that  A-D-A  system  performance  is 
essentially  determined  ahead  of  the  reconstruction  filter.  It  furthermore,  is  a 
performance  measure  that  may  easily  be  used  in  the  lab  to  obtain  performance  data, 
due  to  its  similarity  to  the  standard  noise  power  ratio  (NPR)  measurement. 

Since  the  dominant  errors  in  A-D-A  systems  are  signal  dependent, 
system  noise  cannot  be  measured  in  the  absence  of  an  input  signal.  Consequently, 
NPR  must  be  computed  from  the  two  measurements  shown  in  Figure  2-6.  The  first 
measurement  gives  the  total  signal  plus  noise  power  at  a specified  frequency.  In 
the  second  measurement  the  signal  is  notched  out  at  that  specified  frequency  so 
that  only  noise  is  measured.  The  ratio  of  these  two  measurements  gives  the  NPR. 


S (u) 


NPR  (w) 


SNSR  (u) ) + 1 


(2-3) 


From  (2-3)  we  have  that 


NPR  (id)  - SNSR  (w)  S (w)»  S (u)  (2-4) 

XX 

The  individual  SNSRs  due  to  the  various  error  sources  in  an  A-D-A 

system  add  like  resistors  in  parrallel.  Let  SNSR  (oj)  be  the  SNSR  resulting  from 

n 

the  nth  error  source.  Then  the  total  system  SNSR  is  given  by 


SNSR  (ai) 


1 

SNSR  (to) 


n 


-1 
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For  example,  suppose  only  two  error  sources  are  of  interest  and  the  SNRs  due  to 
each  are  SNSR^  and  SNSR2  where  SNSR^>  SNSR2 . Then  the  second  error  source  dominat 
the  the  total  SNSR  is 


SNSR1  SNSR2 
SNSR1  + SNSR2 


SNSR- 


1 + 


'SNSRj 

snsF 


-1 


(2-6) 


Table  2-1  shows  how  much  the 


total  SNSR  is  degraded  from  SNSR^ 


as  a function  of 


(snsr1/snsr2) . 


TABLE  2-1.  DEGRADATION  BY  SECOND  ERROR  SOURCE 


■sSr 

4.  A-D-A  System  Measurements. 

One  of  the  important  applications  of  our  A-D-A  system  modeling 
and  analysis  is  in  the  determination  of  which  elements  of  the  system  impair 
performance  most.  Since  it  makes  no  sense  to  compare  analog  signals  with 
digital  ones,  there  are  only  two  places  where  system  performance  can  be  measured. 

The  first  is  between  the  sampler  and  quantizer,  and  the  second  is  at  the  output 
of  the  A-D-A  system.  Consequently,  given  only  measurements  from  these  two  locations, 
it  is  very  difficult  to  ascertain  the  source  of  the  dominant  errors  and  thus 
determine  how  to  compensate  for  them. 

However,  our  system  modeling  approach  coupled  with  a few  hardware 
measurements  allows  us  to  examine  trade-offs  between  the  many  A-D-A  system  errors 
and  locate  the  dominant  error  sources.  This  is  accomplished  by  experimentally 
determining  the  A/D,  A/D/A,  and  D/A  level  error  variances,  the  read-in  and  read- 
out timing  jitter  probability  densities,  and  the  channel  transmission  error 
characteristics.  This  information  plus  various  A-D-A  system  specifications  are 
then  combined  with  our  A-D-A  system  equations  on  a computer  to  evaluate  total 
system  performance.  The  result  of  this  approach  is  a set  of  curves  giving 
SNSR  (NPR)  as  a function  of  frequency  by  error  source  in  addition  to  a plot  of 
SNSR  (NPR)  for  all  error  sources.  The  dominant  error  sources  may  immediately  be 
identified  from  these  curves. 

Figure  2-7  shows  a standard  test  setup  for  measuring  the  joint  effect 
of  A/D  and  A/D/A  level  errors.  A typical  set  of  measurements  is  given  in  Figure  2-8 
for  a 9 bit  uniform  quantizer  like  the  one  shown  in  Figure  2-1.  Because  there  is 
only  one  comparator,  all  of  the  error  shown  is  due  to  A/D/A  level  errors. 

•k  . . . ... 

Portions  of  this  material  are  reprinted  here  with  permission  from:  J.F.  Holland, 
Statistical  Analysis  of  Analog-Digital-Analog  Systems,  Ph.D.  dissertation,  Stanford 
University,  March  1974. 
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Figure  2-7.  Block  Diagram  of  Combined  A/D  and  A/D/A  Level  Error  Measurement 


These  measurements  are  entered  into  a computer  program  which 

performs  a least  squares  curve  fit  of  a line  to  the  data  and  then  evaluates  the 

mean  square  error.  The  resulting  slope  of  the  line  is  then  taken  as  the  intended 

step  size  E and  the  resulting  mean  square  error  is  then  used  as  an  estimate  of 

2 2 

the  true  A/D/A  level  error  variance  E a ^ . D/A  level  errors  are  measured  similarly 
as  shown  in  Figure  2-9. 

A variety  of  standard  techniques  for  measuring  timing  jitter  and 
channel  bit  error  rates  are  discussed  in  the  literature.  Since  such  measurements 
are  not  central  to  our  purpose,  we  do  not  elaborate  on  them.  Figures  2-10  and  2-11 
show  test  setups  for  measuring  the  NPR  at  the  output  of  a sampler  and  of  an 
A-D-A  system. 
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leasurement  Test  Setup  for  an  ADA  System 


5.  Specification  of  Test  Input  Processes. 

In  practice,  the  noise  introduced  by  A-D-A  systems  is  not  uniformly 
distributed  across  the  data  band,  but  rather  may  vary  with  frequency  by  as  much 
as  60  dB.  The  noise  is  also  highly  correlated  with  the  signal.  Consequently, 
careful  selection  of  test  input  processes  is  required. 

In  all  of  our  analyses  the  input  signal  spectrum  is  taken  to  be 

white  noise  filtered  by  an  Nth  order  Butterworth  or  Chebyshev  filter.  In  the 

limit  as  N-+®0  these  give  an  ideal  low-pass  (bandpass)  spectrum.  The  Butterworth 
and  Chebyshev  spectrums  are  reasonable  approximations  for  many  signal  spectrums 
and  in  particular  for  those  of  a baseband  composed  of  frequency  multiplexed 
audio  channels  when  there  are  more  than  16  active  channels.  They  also  permit 
an  evaluation  of  the  extent  to  which  an  input  signal  waveform  must  be  filtered 

or  bandlimited  in  order  to  reduce  to  tolerable  level  the  noise  due  to  aliasing 

error.  As  a result,  it  has  become  common  practice  to  simulate  traffic  conditions 
on  FDM  telephone  channels  and  in  other  systems  with  these  spectrums.  It  is 
assumed  that  the  desired  signal  (data  band)  ends  at  the  3 dB  point  of  the  spectrum. 
The  sampling  frequency  is  then  referenced  as  some  multiple  of  this  maximum 
baseband  frequency. 

In  order  to  complete  the  specification  of  the  input,  its 
amplitude  statistics  must  be  identified.  Normally  distributed  amplitude 
statistics  are  particularly  attractive  because  slot  noise  generators  have  normal 
outputs.  Gaussian  statistics  are  often  a good  model  for  many  signals  of  interest. 
In  particular,  for  signals  composed  of  frequency  multiplexed  audio  channels, 
the  normal  assumption  is  especially  good  for  16  or  more  active  channels.  However, 
at  times  the  amplitude  statistics  of  inputs  are  more  nearly  uniformly  than 

•k 

Portions  of  this  material  are  reprinted  here  with  permission  from:  J.F.  Holland, 
Statistical  Analysis  of  Analog-Digital-Analog  Systems,  Ph.D.  dissertation,  Stanford 
University,  March  1974. 
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normally  distributed.  For  example,  the  amplitude  statistics  of  the  input  might 
be  multimodal.  In  the  case  of  speech,  the  amplitude  statistics  are  often  modeled 
by  a Laplace  distribution.  Consequently,  the  analytic  determination  of  A-D-A 
system  performance  for  uniformly  and  Laplacian  distributed  inputs  is  also  useful. 

6.  Use  of  Design  Curves 

A compendium  of  design  curves  are  given  in  the  following  sections. 
They  include  the  effects  quantization,  aliasing,  and  other  errors.  Using  equa- 
tion (2-5),  the  SNSR  for  these  different  error  sources  may  be  added  together 
to  give  the  total  system  SNSR  or  NPR. 

For  example,  from  the  design  curves  in  Sections  3 and  5,  a 10  bit 
system  with  20%  level  errors  set  at  the  optimum  crest  factor  of  4.5,  with  a 6 
pole  1.0  dB  ripple  factor  2.0  MHz  Chebyshev  aliasing  filter  centered  at  1.44  MHz, 
and  with  a 5.76  MHz  sampling  rate  yields  the  NPR  shown  in  Figure  2-12. 
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NPR  (dB) 


Figure  2-12.  Total  System  NPR  Versus  Frequency. 

• 10  Bits  with  20%  Level  Errors  and  Optimum  Crest  Factor  of  4.5 

• 6 Pole  2.0  MHz  Chebyshev  Spectrum  with  1.0  dB  Ripple  Factor  and 
Center  Frequency  of  1.44  MHz 

• 5.76  MHz  Sampling  Frequency 
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SECTION  III 

UNIFORM  QUANTIZATION  DESIGN  CURVES 

1.  Introduction 

This  section  gives  equations  and  design  curves  for  predicting 
the  dynamic  range  limitations  imposed  by  quantization  and  level  error  on  a 
uniform  (linearly  companded)  A/D  converter.  The  results  of  this  section  are 
presented  in  terms  of  SNR  since  quantization  and  level  error  produce  noises 
which  are  not  strongly  correlated  with  the  input  signal  and  whose  power 
spectrums  are  approximately  constant  with  frequency.  Consequently, 


SNSR(f) 


S(f) 

To2 


(3-1) 


where  S(f)  is  the  signal  power  spectrum,  T is  the  sampling  period,  and  o~  is 
the  quantization  plus  level  error  noise  power.  When  the  signal  power  spectrum 


is  nearly  constant  with  frequency, 

2 
a 

S(f) 


s 

2B 


(3-2) 


where  <j  2 is  the  signal  power  and  B is  the  3dB  signal  bandwidth  as  defined  in 
s 

Figure  3-1.  In  this  case  the  SNSR  is  nearly  constant  with  frequency  and  equals 

SNSR  - (3_3) 

2BT 

where  SNR  is  2 

o 

% (3-4) 


SNR 


This  relationship  is  shown  in  Figure  3-2  as  a function  of  normalized  sampling 
rate. 
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Definition  of  Bandwidth  B - Lowpass  Case 


Definition  of  Bandwidth  B - Bandpass  Case 


Figure  3-1.  Definition  of  Signal  Bandwidth 


For  uniform  quantization,  the  step  size  E is 


e * 2~<'q_1^v  - 2-^q-1)no 


(3-5) 


where  q is  the  number  of  bits,  2V  is  the  peak  to  peak  quantization  range,  and 


n is  the  crest  factor  (peak  to  RMS  ratio) . 


The  noise  power 


2 . p2  2 
o + E o_ 
q T 


(3-6) 


(3-7) 


is  the  sum  of  the  cantization  noise  power  o and  the  level  error  noise  power 

q 

2 2 

E a . The  paramett'  a is  the  RMS  value  of  the  level  error.  Then 


1+SNR  n2a  24-(q-1) 

q T 

where  SNR  is  .he  theoretical  SNR  associated  with  quantization. 

q 

2 

a 

SNR  - -5- 
q o 


(3-8) 


(3-9) 


Performance  of  an  A/D  converter  depends  on  the  amplitude 
statistics  of  the  input  signal.  Two  cases  are  considered  here.  The  first  is 
uniform  statistics  which  gives  an  upper  bound  on  performance  and  the  second  is 
Gaussian  statistics  which  gives  an  estimate  of  typical  performance  for  a 
great  number  of  systems. 

2.  Uniform  Amplitude  Statistics 

The  uniform  amplitude  statistics  case  gives  an  upper  bound 
on  performance  since  the  dynamic  range  of  the  input  signal  perfectly  matches 
the  quantization  range.  Hence,  there  is  no  overload  error  introduced  by  limiting 
the  input  signal.  By  definition  the  crest  factor  n - /J"  and 
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SNR  - 4q  =»  6.02q(dB)  (2-10) 

Equation  (3-8)  reduces  to 

4q 

SNR  - — (3-11) 

l+12o_ 

T 

which  is  plotted  in  Figure  3-3. 

Observe  the  variation  in  performance  with  percent  level  errors. 

A manufacturer's  specification  of  + 1/2  LSB  quantization  error  maximum,  with  a 

uniform  distribution  of  level  errors  would  produce  c*T  * 1/12.  Thus,  a„  = 1//12  * 

29%  results  in  a 3 dB  loss  in  SNR  from  (3-11)  which  is  equivalent  to  1/2  bit  less 

quantization  resolution  from  (3-10) . Table  3-1  summarizes  the  number  of  lost 

bits  as  a function  of  a . 

T 


Table  3-1.  Equivalent  Number  of  Lost  Bits 


cT% 

SNR  dB  lost 

Number  of  Lost  Bits 

29 

3 

50 

6 ' 

1 

76 

9 

l*s 

112 

12 

2 

3.  Gaussian  Amplitude  Statistics 

Performance  predictions  assuming  Gaussian  amplitude  statistics 
are  more  nearly  typical  than  for  uniform  statistics  since  actual  signals  are 
not  received  with  their  amplitudes  hard  limited.  Since  an  A/D  converter  can  only 
encode  over  the  peak  to  peak  voltage  range  of  2V,  the  signal  will  be  limited  by 
the  A/D  converter  producing  an  overload  noise.  This  additional  noise  degrades 
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the  performance  of  the  A/D  converter  as  a function  of  crest  factor  n.  Too  small 
a crest  factor  results  in  excessive  overload  noise  while  too  large  a crest  factor 
results  in  a performance  degradation  because  the  full  resolution  of  the  A/D 
converter  is  not  used.  This  is  illustrated  in  Figure  3-4  for  10  bits. 

There  is  thus  an  optimum  crest  factor  for  each  number  of  bits  q. 
This  optimum  crest  factor  is  shown  in  Figure  3-5  for  zero,  40 %,  and  90%  level 
errors.  Observe  that  the  optimum  crest  factor  increases  almost  linearly  with 
the  number  of  bits  unlike  the  uniform  amplitude  statistics  case.  For  this 
optimum  crest  factor,  Figure  3-6  gives  SNR  versus  the  number  of  bits  q. 


Figure  3-5.  Optimum  Crest  Factor  Versus  Number  of 
Bits  for  Gaussian  Amplitude  Statistics. 
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QUANTIZATION  SNR  (dB) 


2 A 6 8 10  12 


NUMBER  OF  BITS  q 


Figure  3-6.  Quantization  SNR  Versus  Number  of 
Bits  for  Gaussian  Amplitude  Statistics. 
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. Design  Curves  for  Gaussian  Statistics 

Design  curves  of  SNR  as  a function  of  crest  factor  for  uniform 
quantizers  and  Gaussian  amplitude  statistics  follow.  They  cover  the  range  of 
2 to  30  bits  and  are  parametric  in  RMS  level  errors.  These  curves  were  obtained 
from  the  equations  given  in  Appendix  A. 

For  example,  a 10  bit  A/D  converter  with  40%  level  error  has 
a SNR  = 47.3  dB  at  the  optimum  crest  factor  of  n = 4.3.  With  a normalized 
sampling  rate  of  2.5,  the  SNSR  = 48.3  dB  in  the  center  of  the  band  and  3 dB 
less  at  band  edge. 
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Uniform  Quantization  SNR  Versus  Crest  Factor  for  2 Bits  and  0,  10,  ...  80,  90 
Percent  Normalized  Level  Errors. 
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Uniform  Quantization  SNR  Versus  Crest  Factor  for  3 Bits  and 
0,  10,  ...  80,  90  Percent  Normalized  Level  Errors. 


Uniform  Quantization  SNR  Versus  Crest  Factor  for  4 Bits  and 
0,  10,  ...  80,  90  Percent  Normalized  Level  Errors. 


Uniform  Quantization  SNR  Versus  Crest  Factor  for  5 Bits  and 
0,  10,  ...  80,  90  Percent  Normalized  Level  Errors. 
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Uniform  Quantization  SNR  Versus  Crest  Factor  for  7 Bits  and 
0,  10,  ...  80,  90  Percent  Normalized  Level  Errors, 
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Uniform  Quantization  SNR  Versus  Crest  Factor  for  8 Bits  and 
0,  10,  ...  80,  90  Percent  Normalized  Level  Errors. 
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Uniform  Quantization  SNR  Versus  Crest  Factor  for  9 Bits  and 
0,  10,  ...  80,  90  Percent  Normalized  Level  Errors. 


Uniform  Quantization  SNR  Versus  Crest  Factor  for  10  Bits  and 
0,  10,  ...  80,  90  Percent  Normalized  Level  Errors. 
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Uniform  Quantization  SNR  Versus  Crest  Factor  for  11  Bits  and 
0,  10,  ...  80,  90  Percent  Normalized  Level  Errors. 


Uniform  Quantization  SNR  Versus  Crest  Factor  for  12  Bits  and 
0,  10,  ...  80,  90  Percent  Normalized  Level  Errors. 


Uniform  Quantization  SNR  Versus  Crest  Factor  for  13  Bits  and 
0,  10,  ...  80,  90  Percent  Normalized  Level  Errors. 


Uniform  Quantization  SNR  Versus  Crest  Factor  for  14  Bits  and 
0,  10,  ...  80,  90  Percent  Normalized  Level  Errors. 
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Uniform  Quantization  SNR  Versus  Crest  Factor  for  15  Bits  and 
0,  10,  ...  80,  90  Percent  Normalized  Level  Errors. 
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Uniform  Quantization  SNR  Versus  Crest  Factor  for  18  Bits  and 
0,  10,  ...  80,  90  Percent  Normalized  Level  Errors. 


Uniform  Quantization  SNR  Versus  Crest  Factor  for  19  Bits  and 
0,  10,  ...  80,  90  Percent  Normalized  Level  Errors. 


Uniform  Quantization  SNR  Versus  Crest  Factor  for  20  Bits  and 
0,  10,  ...  80,  90  Percent  Normalized  Level  Errors. 
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Uniform  Quantization  SNR  Versus  Crest  Factor  for  22  Bits  and 
0,  10,  ...  80,  90  Percent  Normalized  Level  Errors. 


Uni  fora  Quantization  SNR  Versus  Crest  Factor  for  23  Bits  and 
9.  10,  ...  80,  90  Percent  Normalized  Level  Errors. 
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Uniform  Quantization  SNR  Versus  Crest  Factor  for  24  Bits  and 
0,  10,  ...  80,  90  Percent  Normalized  Level  Errors. 


Uniform  Quantization  SNR  Versus  Crest  Factor  for  26  Bits  and 
0,  10,  ...  80,  90  Percent  Normalized  Level  Errors. 
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Uniform  Quantization  SNR  Versus  Crest  Factor  for  29  Bits  and 
0,  10,  ...  80,  90  Percent  Normalized  Level  Errors. 


SECTION  IV 


LOGARITHMIC  QUANTIZATION  DESIGN  CURVES 


1.  Introduction 

This  section  gives  design  curves  for  predicting  the  dynamic  range 
limitations  imposed  by  quantization  on  a logarithmically  companded  A/D  converter. 
The  basic  theory  is  the  same  as  presented  in  Section  3 except  that  the  quantiza- 
tion is  no  longer  uniform.  Consequently,  only  a discussion  of  logarithmic  compand- 
ing is  included  in  this  section.  Both  Gaussian  and  Laplacian  amplitude  statistics 
are  considered  and  the  equations  from  which  these  curves  were  obtained  are  given 
in  Appendix  A. 

2.  Logarithmic  Companding 

As  discussed  in  Section  3,  uniform  quantization  is  only  optimum 
when  the  input  signal  has  uniformly  distributed  amplitude  statistics.  For  other 
amplitude  statistics  nonuniform  quantization  gives  better  theoretical  performance. 
Quantization  of  a compressed  version  of  the  input  signal  is  logically  equivalent 
to  nonuniform  quantization  and  is  generally  easier  to  implement  in  hardware. 

Signal  compression  achieves  the  same  goal  as  nonuniform  quantization  by  amplifying 
weak  portions  of  the  signal  more  than  strong  portions  without  altering  the  quanti- 
zation step  size. 

Figure  4-1  gives  a block  diagram  of  a logarithmically  companded 
A-D-A  system.  It  consists  of  a logarithmic  compressor,  a uniform  quantization 
A-D-A  system,  and  an  exponential  expander.  The  expander  is  chosen  to  have  the 
inverse  characteristic  of  the  compressor  in  order  to  restore  the  proper  amplitude 
statistics  to  the  output  signal.  Let  x(t)  and  y(t)  be  the  input  and 
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Figure  4-1.  Logarithmically  Companded  A-D-A  System. 


output  of  the  compressor,  respectively.  Then  the  logarithmic  compressor  is 
defined  by 


y(t) 


V to  .1  + Ux(t)/V 

l n f 1 + pi 
- . 


. t to  [l  - ux(t)/v] 

_v ~[i  + p]  ' 


x(t)  > 0 


x(t)  < 0 


(4-1) 


where  p is  the  compression  factor  and  2V  is  the  peak  to  peak  quantization  range. 

This  equation  is  plotted  in  Figure  4-2  for  several  values  of  p.  Generally 
speaking,  the  slower  the  input  signal  probability  density  function  goes  to  zero 
as  the  magnitude  of  the  input  goes  to  infinity,  the  more  logarithmic  compression 
will  improve  performance  relative  to  SNR.  This  is  exemplified  in  Figure  4-3  and 
4-4  where  SNR  versus  crest  factor  is  plotted.  In  both  figures  the  second  curve 
gives  the  optimum  SNR  for  all  values  of  compression  factor  p.  With  Gaussian 
amplitude  statistics  the  optimum  p = 2.5  whereas  with  Laplacian  amplitude  statistics 
the  optimum  p = 8.0.  Observe  the  optimum  companding  only  improves  performance  over 
no  companding  (p  = 0)  by  1.0  dB  with  Gaussian  amplitude  statistics.  However,  with 
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SNR(DB) 


Figure  4-4.  SNR  Versus  Crest  Factor  For  5 Bits  And  Laplacian 
Amplitude  Statistics. 
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Laplacian  amplitude  statistics  there  is  over  3.0  dB  improvement.  Nevertheless, 
the  Gaussian  case  with  no  companding  yields  a higher  SNR  than  the  Laplacian  case 
with  optimum  companding. 

From  these  curves,  optimum  SNR  is  only  maintained  over  a small 
range  of  crest  factor  or  alternatively  over  a small  range  of  input  signal  power. 
It  is  often  desirable  to  maintain  a minimum  SNR  (say  20  dB)  over  some  range  of 
input  signal  powers.  With  a compression  factor  u = 100,  this  minimum  SNR  is 
maintained  with  Gaussian  amplitude  statistics  for  crest  factors  between  9 and  27 
dB.  Similarly,  it  is  achieved  with  Laplacian  amplitude  statistics  for  crest 
factors  between  13  and  28  dB.  Thus,  the  larger  the  compression  factor  beyond  the 
optimum  value  the  lower  the  maximum  SNR,  but  the  larger  the  range  in  crest  factor 
or  signal  power.  The  no  companding  case  gives  the  least  range  in  crest  factor. 
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3.  Design  Curves  for  Gaussian  Statistics 


Design  curves  of  SNR  as  a function  of  crest  factor  for  logarith- 
mically companded  quantizers  and  Gaussian  amplitude  statistics  follow.  They  cover 
the  range  of  2 to  12  bits  and  are  parametric  in  compression  factor. 

For  example,  a 10  bit  A/D  converter  with  u = 200  has  a SNR  = 50.2 
dB  at  a crest  factor  of  15  dB.  With  a normalized  sampling  rate  of  2.5,  the 
SNSR  = 51.2  dB  in  the  center  of  the  band  and  3 dB  less  at  band  edge. 
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. Design  Curves  for  Laplacian  Statistics 


Design  curves  of  SNR  as  a function  of  crest  factor  for  logarith- 
mically companded  quantizers  and  Laplacian  amplitude  statistics  follow.  They 
cover  the  range  of  2 to  12  bits  and  are  parametric  in  compression  factor. 

For  example  a 7 bit  A/D  converter  with  y = 1000  will  maintain  a 
minimum  SNR  = 28  dB  over  the  crest  factor  range  15  dB  to  51  dB.  This  corresponds 
to  a 36  dB  range  in  input  signal  power. 
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SECTION  V 

ALIASING  ERROR  DESIGN  CURVES 

1.  Introduction 

This  section  gives  design  curves  for  predicting  the  dynamic 
range  limitations  imposed  by  aliasing  (spectral  folding)  error  as  a result  of 
sampling.  The  curves  are  of  SNSR  versus  normalized  frequency  parametric  in 
the  normalized  sampling  rate. 

The  amount  of  aliasing  error  depends  on  the  spectral  shape 
of  the  signal  being  sampled.  Aliasing  error  may  vary  50  dB  over  the  passband 
as  shown  in  Figure  5-1.  Consequently,  a variety  of  curves  are  given  to 
approximate  the  multitude  of  spectral  shapes.  Since  most  aliasing  filters  are 
well  approximated  at  band  edge  by  a Chebyshev  or  Buttervorth  filter,  the  SNSR 
curves  have  been  generated  for  signals  which  are  the  output  of  a Chebyshev  or 
Buttervorth  filter  driven  with  Gaussian  white  noise. 

The  curves  are  given  for  the  lowpass  case,  but  may  be  extrapolated 
with  care  to  any  bandpass  case  using  the  bandwidth  definition  shown  in  Figure  5-2. 
Pictures  such  as  Figure  5-3  can  be  very  helpful  in  avoiding  mistakes.  Observe 
that  in  the  bandpass  case  in  addition  to  aliasing  error  there  is  an  imaging 
error  which  is  mathematically  analogous  to  aliasing  error.  When  the  signal 
spectrum  is  symmetric  about  the  carrier,  both  errors  are  simultaneously  minimized 
by  choosing  the  center  frequency  to  be  one  fourth  the  sampling  frequency  f . 


f = f /4 
c s 


(5-1) 


For  this  special  case,  no  correction  in  normalized  sampling  frequency  is  required 
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SNSR  (dB) 


NORMALIZED  SAMPLING  FREQUENCY 


U— B-t») 


Definition  of  Bandwidth  B - Lowpass  Case 


Definition  of  Bandwidth  B - Bandpass  Case 


Figure  5-2.  Definition  of  Signal  Bandwidth 
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I 

4 

when  extrapolating  the  lowpass  curves  to  the  bandpass  case  because 

(f  - f ) - f = f - 2f  = 2f  (5-2) 

sc  c s c c 

However,  even  when  (5-1)  does  not  hold,  the  lowpass  curves  may  be  extrapolated 
by  drawing  a picture  and  carefully  computing  the  equivalent  normalized  sampling 
frequency  for  the  aliasing  and  imaging  errors. 

2.  Design  Curves 

Design  curves  of  SNSR  versus  normalized  frequency  follow.  They 
are  parametric  in  the  normalized  sampling  frequencies  2.0,  2.1,  ...  3.9,  4.0  and 
are  given  for  2,  3,  ...  10  pole  filters.  The  filter  ripple  factor  in  dB  is 
specified  at  the  bottom  of  each  curve.  The  0.0  dB  ripple  factor  curves  are  for 
Butterworth  filters  and  the  others  are  for  Chebyshev  filters. 

For  example,  suppose  white  noise  is  passed  through  a 1.0  MHz 
6 pole  1.0  dB  ripple  factor  lowpass  Chebyshev  filter.  From  the  following  curves 
a sampling  rate  of  2.5  MHz  (2.5  normalized  sampling  frequency)  yields  a maximum 
SNSR  = 67  dB  at  zero  and  a minimum  SNSR  = 37  dB  at  1.0  MHz. 

Now  suppose  white  noise. is  passed  through  a 2.0  MHz  6 pole  1.0  dB 
ripple  factor  bandpass  Chebyshev  filter  centered  at  1.25  MHz.  A sampling  rate  of 
5.0  MHz  (2.5  normalized  sampling  frequency)  is  four  times  the  center  frequency. 
Consequently,  the  maximum  SNSR  = 67  dB  occurs  at  1.25  MHz  and  the  minimum  SNSR  = 

37  dB  occurs  at  0.25  MHz  and  2.25  MHz. 

Next  suppose  white  noise  is  passed  through  a 2.0  MHz  6 pole  1.0  dB 
ripple  factor  bandpass  Chebyshev  filter  centered  at  1.25  MHz.  However,  a sampling 
rate  of  6.0  MHz  is  chosen  (3.0  normalized  sampling  rate).  Then  SNSR  = 37  dB 
at  0.25  MHz  and  SNSR  - 67  dB  at  1.25  MHz,  but  SNSR  = 55  dB  at  2.25  MHz.  Thus, 
there  is  more  imaging  error  than  aliasing  error. 
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Aliasing  Error  SNSS.  Versus  Normalized  Frequency  For  Normalized  Sampling 


Rates  of  2.0,  2.1,  ...  3.9,  4.0. 
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Aliasing  Error  SNSR  Versus  Normalized  Frequency  For  Normalized  Sampling 
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Rates  of  2.0,  2.1,  ...  3.9,  4.0. 


5-12 


Aliasing  Error  SNS-R  Versus  Normalized  Frequency  For  Normalized  Sampling 
Rates  of  2.0,  2.1,  ...  3.9,  4.0. 
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Aliasing  Error  SNSR  Versus  Normalized  Frequency  For  Normalized  Sampling 


Rates  of  2.0,  2.1,  ...  3.9,  4.0. 
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Aliasing  Error  SNSR  Versus  Normalized  Frequency  For  Normalized  Sampling 
Races  of  2.0,  2.1,  ...  3.9,  4.0. 
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Aliasing  Error  SNSR  Versus  Normalized  Frequency  For  Normalized  Sampling 
Rates  of  2.0,  2.1,  ...  3.9,  4.0. 
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Races  of  2.0,  2.1, 


3.9,  4.0. 
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Aliasing  Error  SNSR  Versus  Normalized  Frequency  For  Normalized  Sampling 
Rates  of  2.0,  2.1,  ...  3.9,  4.0. 
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Aliasing  Error  SNSR  Versus  Normalized  Frequency  For  Normalized  Samplirg 
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2.0,  2.1,  ...  3.9,  4.0. 
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Rates  of  2.0,  2.1,  ...  2.9,  4.0. 
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Rates  of  2.0,  2.1,  ...  3.9,  4.0. 
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Aliasing  Error  SNSR  Versus  Normalized  Frequency  For  Normalized  Sampling 
Races  of  2.0,  2.1,  ...  3.9,  4.0. 
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Rates  of  2.0,  2.1,  ...  3.9,  4.0. 
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Rates  of  2.0,  2.1,  ...  3.9,  4.0. 
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Aliasing  Error  SNSR  Versus  Normalized  Frequency  For  Normalized  Sampling 
Rates  of  2.0,  2.1,  ...  3.9,  4.0. 


5-44 


Aliasing  Error  SNSB.  Versus  Normalized  Frequency  For  Normalized  Sampling 
Rates  of  2.0,  2.1,  ...  3.9,  4.0. 
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Rates  of  2.0,  2.1,  ...  3.9,  4.0. 
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Races  of  2.0,  2.1,  ...  3.9,  4.0. 
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Rates  of  2.0,  2.1,  ...  3.9,  4.0. 
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Aliasing  Error  SNSU  Versus  Normalized  Frequency  For  Normalized  Sampling 

Rates  of  2.0,  2.1,  ...  3.9,  4.0. 
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Rates  of  2.0,  2.1,  ...  3.9,  4.0. 
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Rates  of  2.0,  2.1,  ...  3.9,  4.0. 
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Rates  of  2.0,  2.1,  ...  3.9,  4.0. 
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Aliasing  Error  SN&R  Versus  Normalized  Frequency  For  Normalized  Sampling 
Rates  of  2.0,  2.1,  ...  3.9,  4.0. 


5-62 


I 


Aliasing  Error  SNSR  Versus  Normalized  Frequency  For  Normalized  Sampling 


Rates  of  2.0,  2.1,  ...  3.9,  4.0. 
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Rates  of  2.0,  2.1, 


3.9,  4.0. 
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Aliasing  Error  SNSU  Versus  Normalized  Frequency  For  Normalized  Sampling 
Rates  of  2.0,  2.1,  ...  3.9,  4.0. 
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Rates  of  2.0,  2.1,  ...  3.9,  4.0. 
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Aliasing  Error  SNSR  Versus  Normalized  Frequency  For  Normalized  Sampling 


Rates  of  2.0,  2.1,  ...  3.9,  4.0. 
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SECTION  VI 


EFFECT  OF  DITHER  SIGNALS  IN  A-D-A  SYSTEMS 


1.  Introduction 

In  the  previous  sections,  performance  has  been  considered  in 
terms  of  SNSR  and  SNR.  The  fact  that  the  instantaneous  error  associated  with 
quantization  is  a deterministic  function  of  the  input  signal  has  not  been 
examined.  This  deterministic  error  results  in  contouring.  With  image  signals, 
a ramp  change  in  grey  scale  results  after  quantization  in  step  changes  in  the 
intensity  level.  This  staircase  effect  is  called  contouring.  Pictures  with 
contouring  are  often  more  objectionable  than  pictures  without  contouring  having 
the  same  output  SNR.  A similar  phenomenon  occurs  with  speech  signals.  Contouring 
may  be  eliminated  by  the  use  of  wideband  dither  signals  as  discussed  in  this 
section. 

Equations  and  design  curves  for  predicting  the  dynamic  range 
limitations  imposed  by  quantization  in  A-D-A  systems  employing  dither  signals 
are  given  in  this  section.  A general  discussion  on  the  effect  of  dither  signals 
is  presented  first.  Then  performance 'and  optimization  are  examined  based  on  the 
equations  derived  in  Appendix  A and  B. 

2.  Effect  Of  Dither  Signals 

Figure  6-1  shows  an  A-D-A  system  with  dither  signals.  Process  y(t) 
is  the  input  signal  and  r(t)  is  the  wideband  dither  signal.  Delay  T is  the  total 
propagation  delay  of  the  A-D-A  system.  The  purpose  of  the  input  dither  signal 
is  to  introduce  random  zero  mean  quantization  errors  in  a fashion  similar  to  A/D 
level  errors.  The  output  dither  signal  then  synchronously  subtracts  out  the 
input  dither.  The  result  is  that  the  quantization  error  is  randomized  and  is  no 
longer  a deterministic  function  of  the  input  signal  y(t). 
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INPUT  DITHER 


OUTPUT  DITHER 


Figure  6-1.  A-D-A  System  With  Dither  Signals 

Define  B to  be  the  A-D-A  system  input  signal  to  dither  signal 


power  ratio 


B = 


2 2 
a + a 
s r 


(6-1) 


2 2 

where  a is  the  input  signal  y(t)  power  and  a is  the  dither  signal  r(t)  power. 

S I* 

Let  n again  denote  crest  factor  (CF)  and  u denote  the  logarithmic  compression 
factor  (u).  Equations  (3-5)  and  (6-1)  give  the  relationship 


E 2 


q-1 


E 2 


q-1 


n = 


J 2~  T 

\ a +o 


V7 


(6-2) 


s r r 

where  q is  the  number  of  bits  and  E is  the  uniform  quantizer  step  size.  Hence, 


4 


q-1 


B = 


n2  (a^E)2 


(6-3) 


Consider  for  example  a 2 bit  A-D-A  system  with  Gaussian  dither  and  linear  compand- 
ing (u=0).  For  a crest  factor  of  2 the  instantaneous  error  as  a function  of  the 
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input  y(t)  is  given  in  Figures  6-2  and  6-3.*  The  B = 60  dB  case  corresponds  to 
no  dither  and  shows  the  deterministic  error  which  produces  contouring.  Observe 
that  this  deterministic  error  diminishes  as  the  dither  power  increases  and  B 
decreases.  The  B = 10  dB  case  still  contains  oscillation  so  the  optimum  value 
of  B must  be  something  less.  The  B = 1.0  dB  case  has  no  oscillation  but  the 
error  is  large  for  most  values  of  input  y(t)  because  too  much  dither  noise  is 
present.  Hence,  the  optimum  value  of  B must  lie  somewhere  between  1.0  and  10  dB. 

Figure  6-4  shows  the  same  quantization  error  as  Figure  6-3  but  for 
a crest  factor  of  4-  Observe  that  the  curves  have  a different  shape.  From 
equation  (6-3)  B varies  quadratically  with  crest  factor  n and  a factor  of  2 change 
in  n corresponds  to  a 6.0  dB  change  in  B.  Decreasing  the  values  of  B by  6.0  dB 
gives  the  curves  shown  in  Figure  6-5  which  have  the  same  shape  as  those  in 
Figure  6-3-  This  verifies  the  quadratic  dependence  of  B on  crest  factor  n. 

From  this  2 bit  example,  the  shape  of  the  error  curves  should  be 

clear.  Too  large  a value  of  B results  in  an  oscillatory  error  and  too  small  a 

value  of  B gives  a nonoscillatory  error  which  is  large  for  most  values  of  input 
y(t).  This  is  true  regardless  of  the  number  of  bits  used  in  the  A-D-A  system 

Figures  6-6,  6-7,  and  6-8  show  quantization  error  versus  input 
signal  amplitude  for  a 5 bit  A-D-A  system,  linear  companding,  and  a crest  factor 
of  3-  Observe  that  B = 20  dB  appears  to  be  nearly  optimum  since  it  results  in 
small  values  of  quantization  error  over  the  entire  encoding  range.  Thus,  no 
contouring  would  occur. 

The  use  of  dither  is  not  limited  to  linearly  companded  systems. 
Figures  6-9,  6-10,  and  6-11  show  quantization  error  versus  input  signal  amplitude 
for  a 5 bit  A-D-A  system  with  logarithmic  companding,  y = 100,  and  a crest  factor 


^Because  of  a finite  number  of  points  and  the  computer  interpolation  algorithms, 
plots  of  the  no  dither  case  (B  = 60  dB)  have  transitions  which  are  not  vertical 
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Figure  6-11.  A Blow-up  Of  The  Quantization  Error  Shown  In  Figure  6-10 


of  4*  Observe  that  dither  signals  even  eliminate  contouring  in  nonlinearly 
companded  A-D-A  systems. 

Return  again  to  the  linearly  companded  5 bit  case.  In  Figure  6-6 
the  quantization  error  is  plotted  for  B = 20  dB  and  a crest  factor  of  3.  Increas- 
ing the  crest  factor  to  4 gives  the  curves  shown  in  Figure  6-12.  Observe  the 
oscillation  in  the  B = 20  dB  curve.  From  equation  (6-3)  a 4/3  increase  in  crest 
factor  implies  a 2.5  dB  decrease  in  B.  Figure  6-13  shows  the  quantization  error 
when  B is  decreased  by  2.5  dB.  As  expected,  the  curves  in  Fig-ares  6-6  and  6-13 
have  the  same  shape.  Similarly,  if  the  crest  factor  is  increased  to  15  and  the 
value  of  B decreased  by  14  dB,  the  curves  shown  in  Figure  6-14  again  have  the 
same  shape  as  those  in  Figure  6-6. 

Thus,  the  use  of  dither  signals  is  an  effective  method  of  eliminating 
contouring  even  in  nonlinearly  companded  systems.  However,  because  of  the  quadratic 
dependence  of  B on  crest  factor,  practical  applications  are  probably  limited  to 
linearly  companded  systems.  In  practice  pseudorandom  dither  signals  are  used  so 
that  proper  synchronization  can  be  maintained. 


3 . Performance  With  Dither  Signals 

General  formulas  for  arbitrary  amplitude  statistics  are  given  in 
Appendix  A and  B for  determining  the  performance  of  A-D-A  systems  using  dither 
signals.  In  the  following  discussion  only  the  Gaussian  input  signal  y(t)  with 
Gaussian  dither  signal  r(t)  case  is  considered.  Equation  (B-65)  of  Appendix 


B gives  the  relationship 


where 


SNRy  = SNRt  1 - 1/B  (6-4) 
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1.33  3.33 


is  the  SNR  determined  from  the  design  curves  in  Sections  3 and  4> 


I 


SNR  = 
7 


(6-6) 


2 

is  the  output  SNR  for  the  input  signal  y( t),  ana  is  the  quantization  noise 
power.  Observe  that  the  degradation  due  to  the  use  of  dither  signals  is  less 
than  0.5  dB  for  values  of  B greater  than  10  dB. 


4.  Optimization  With  Dither  Signals 

Rather  than  adopting  some  rigid  mathematical  procedure  for  opti- 
mizing A-D-A  systems  with  dither,  our  approach  is  purely  practical.  The  objective 
in  using  dither  signals  is  to  eliminate  contouring.  Consequently,  we  choose  a 


value  of  B such  that  the  instantaneous  quantization  error  is  minimized  over  the 
values  of  input  signal  y(t)  that  are  of  interest.  Considering  again  the  5 bit 
case  with  linear  companding  Table  6-1  gives  a number  of  values  for  B as  computed 
from  equation  (6-3).  From  Figures  6-6,  6-7,  6-3,  6-13,  and  6-14,  (o y/E)  = 0.5 
gives  good  results.  This  is  an  intuitively  satisfying  value.  For  this  value 

Table  6-1.  Value  For  B With  5 Bits 


(a/E) 

B(dB) 

n = 3 

ii 

.p- 

43 

II 

M 

1/16 

38.62 

36.12 

24.64 

1/8 

32.60 

30.10 

18.62 

1/4 

26.58 

24-08 

12.60 

1/2 

20.56 

18.06 

6.58 

1 

14.54 

12.04 

0.56 

3/2 

11.02 

8.52 

- 2.96 

equation  (6-3)  becomes 


(Oy/E)  = 0.5 


(6-7) 


6-18 


w 


T 


From  this  equation  and  the  optimum  crest  factors  given  in  Sectior  3,  Table  6-2 
gives  approximately  optimum  values  for  B.  These  approximate  optimums  are 
verified  in  Figures  6-15  through  6-23  for  the  cases  listed  in  Table  6-2.  In 
specific  applications,  refinements  in  these  optimums  may  be  desirable. 

Table  6-2.  Approximate  Optimum  Values  Of  B 
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APPENDIX  A 


DERIVATION  OF  QUANTIZATION  NOISE  FORMULAS 

A1 . Introduction 

Equations  describing  the  quantization  noise  power  in  A-D-A  systems 
are  derived  in  this  appendix  for  Gaussian  and  Laplace  amplitude  statistics.  The 
formulas  are  applicable  to  both  linearly  and  nonlinearly  companded  systems  and 
are  suitable  for  programming  on  a calculator.  In  Section  A 2 a general  equation 
is  derived  for  the  quantization  noise  power  for  arbitrary  amplitude  statistics. 
This  result  is  specialized  to  the  Gaussian  and  Laplace  special  cases  in  Sections 
A3  and  A4,  respectively.  Section  A5  then  gives  the  equations  for  the  quantizer 
steps  for  the  linearly  and  logarithmically  companded  cases. 

A 2.  Derivation  of  General  Noise  Formula 

Define  y(t)  "to  be  the  wide  sense  stationary  process  at  the  input 
to  the  A/D  converter.  Let  z(t)  be  the  quantizer  output  defined  by 

z(t)  = Zn  y(t)  C [l^,  YnJ  n = 1,2,.* -N  (A-l) 

where  the  number  of  levels  N >,  4 is  even, 


*o  ‘ h <—<  th-i  < V “i  Z1  ' z2  *— * h-1  < h 


as  shown  in  Figure  Al.  Define  Yq  = - 00 , Y^ 2 = 0,  = ”,  and  assume  the 

symmetry  relationships 


= ~ ZN-n  f-1  (A-2) 

Zn  = _ZH-n+l  n = l,2.---N  (A-3) 

These  assumptions  are  consistent  with  nearly  every  manufactured  A/D  converter. 
Also  define  f(y)  to  be  the  probability  density  function  for  y(t)  and  assume  that 
f(y)  is  an  even  function,  i.e., 

f(-y)  = f(y)  (A-4) 

A-l 


This  is  consistent  with  assuming  y(t)  is  a zero  mean  process  and  the  A/D  converter 

2 

is  bipolar  as  shown  in  Figure  Al.  Define  a to  be  the  variance  of  the  input 


a2  = E{y2(t)}  = / y2  f(y)dy 


(A-5) 


Then  the  quantization  noise  power  is  given  by 


N -I 


o2  = E{  [ y(t)  - z(t)  ] } 


■Z 

n=l  JJ 


[ 7 - Z n ] f (7)^7 


(A-6) 


Define  the  following  functions 


?o(j/a)  = f of(ox)dx  = f f(x)dx 
J -00  J -oo 

,7/° 

^(y/a)  = / axf (ox)dx  = J / 

%/  — OO  —00 


xf (x)dx 


(A-7) 


(A-6) 


FQ(y/a)  is  related  to  the  distribution  function  associated  with  the  probability 
density  function  f(y)  and  F-^y/o)  is  the  partial  first  moment  of  y(t)/o.  The 
below  derivation  expresses  the  quantization  noise  power  given  by  (A-6)  in  terms 
of  these  functions. 

Expanding  (A-6)  and  applying  definitions  (A-7)  and  (A-8)  yields 


*See  equation  (2-73)  of:  J.  F.  Holland,  Statistical  Analysis  of  Analog- 
Digital-Anal  no  Svatama-  Ph.D.  dissertation,  Stanford  University,  March  197^. 


I 


A-4 


Using  the  symmetry  conditions  and  the  properties  of  even  and  odd  functions, 
(A-10)  may  be  manipulated  into  the  form 


(tf-  £W(*)*]..(w 

n=i  -I 


= 1 + 


- z 


n=N/ 2+1 


- E [(¥)-£)]  >x(f) 

n=l  "* 

+ 2 [(^).(^)]Fi<0) 

= 1+ fr)2-2  I'tM2-^)2]^^) 

n=l  u ' J ' / 


(A- 11) 


Equation  (A- 11)  is  the  desired  formula. 


Similarly,  the  correlation  between  the  input  y(t)  and  the  quantization  noise  is 


A/3.  Formulas  for  Gaussian  Amplitude  Statistics 

In  the  case  of  Gaussian  amplitude  statistics,  the  probability 
density  function  is 

f(y)  = ' exp  (-  y2/2o2)  (A-13) 

V2tt  a 

■f  (j/yJ'P  a)]  (A-l4) 

exp  (-y2/2a2)  (A-15) 

where  erf  ( ) is  the  error  function. 

Furthermore,  it  can  be  shown  in  the  case  of  Gaussian  amplitude  statistics  that 

£ 

the  crosscorrelation  between  the  input  y(t)  and  the  quantization  noise  is 
Ryq(x)  = E{y(t+x ) [y(t)-z(t)  ] } 

= 5 Ryy  (t)  (A-16) 

where  (t)  is  the  autocorrelation  function  of  the  input 

Ryy(x)  = E{y(t+x)  y(t) } (A-17) 

and  5 is  given  by  (A-12) . 


* 

By  direct  integration 

F0  (y/a)  = i [ 


1 + e: 


and 


F-L  (y/a)  = ~ 


•y/2ir 


* 

See  equation  (2-168)  of:  J.  F.  Holland,  Statistical  Analysis  of  Annlnp- 
Digltal- Analog  Systems.  Ph.D.  dissertation,  Stanford  University,  March  1974. 
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A4.  Formulas  for  Laplace  Amplitude  Statistics 

In  the  case  of  Laplacian  amplitude  statistics,  the  probability 
density  function  is 


f(y)  = " exp  (-  yj2\  |y|/a) 


V? 


By  direct  integration 


and 


F (y/o)  = £ exp  (^y/a)  y < 0 


?i(7/a)  exp  (V2V/a) 


2'  r - 1 


A-8 


(A-18) 


(A-19) 


y < 0 (A- 20) 


j 
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AS.  A/D  Converter  Transition  and  Output  Values 

The  final  set  of  formulas  for  evaluating  the  quantization  noise 
power  are  those  for  the  transitions  <X  > and  those  for  the  outputs  cZ  > . Define 

EL 

the  crest  factor  (peak  to  RMS  ratio)  to  be 


n = 


V 

a 


(A-21) 


where  2V  is  the  peak  to  peak  quantization  range.  In  the  case  of  uniform  quanti- 
zation (linear  companding)  the  transitions  and  outputs  are 


Hence, 


Y _ ..(gn-N)..  v 

n N 


Z 

n 


(2n-l-N) 

N 


_n  _ (2n-N) 

a n N 

fn  = (2n-l-N) 

a n N 


n = 1,2, • • *N-1 
n = 1,2, •••N 


n = 1,2, •■•N-l 


n - 1,2, • • *N 


(A- 22) 

(A-23) 

(A-24) 

(A-25) 


Observe  that  these  formulas  have  the  symmetry  properties  discussed  in  Section  A 2. 

The  effect  of  compressing  the  input  prior  to  A/D  conversion  and 
subsequently  expanding  the  output  of  the  D/A  converter  can  be  represented  by 
expanding  the  transitions  <Yq>  and  the  outputs  < Zn > with  the  corresponding  com- 
panding law.  In  logarithmic  companding  the  compression  law  is  given  by 


y(t)  = 


In  [1  + v x(t)/V] 
In  [l  + y] 

In  [l  - v x(t)/v] 
In  [l  + u] 


where  y is  the  compression  factor. 


x(t)  > 0 

x(t)  < 0 


(A-26) 


.... 


A-9 


I 


Observe  that  in  the  limit  as  u goes  to  zero 

lim  y(t)  = x(t)  (A-27) 

u—  0 

The  corresponding  expansion  law  is  obtained  by  solving  (A-26)  for  x(t). 

( j[  + 

i(t)  = ' 

(-;  ([i  + p]-7<t>/T-i) 

Hence,  the  transitions  and  outputs  are  given  by 

- - f ([1  + »]  - l) 

for  logarithmic  companding. 


A-10 


y(t)  > 0 

(A-28) 

y(t)  < o 


n=l,2,---“-l  (A-29) 

n=l,2,-*-|  (A- 30) 


Bl.  DITRODUCTIOS 

Equations  describing  the  effect  of  dither  signals  on  the  quantiza- 
tion error  power  in  A-D-A  systems  are  derived  in  this  appendix  for  arbitrary 
amplitude  statistics.  The  formulas  are  applicable  to  both  linearly  and  nonlinearly 
companded  systems. 

Figure  31  shows  an  A-D-A  system  with  dither  signals.  Process  r(t) 
is  the  input  dither  signal  and  s(t)  is  the  output  dither  signal.  In  the  classical 
case  r(t)  and  s(t)  are  identical  and  small  in  power  compared  to  input  y(t).  In 
general  the  dither  signals  might  be  unwanted  signals  received  with  y(t)  or  corrupting 
the  A-D-A  system  output  z(t).  An  example  is  A/D  and  D/A  level  error  noises. 


Figure  31.  A-D-A  System  with  Dither  Signals 

i 

The  below  analysis  is  applicable  to  al 1 these  cases. 

The  analysis  problem  is  formulated  in  Section  32.  The  cases  of 
independent  dithers  and  identical  dithers  are  examined  in  Sections  33  arid  34.  Then 
the  equations  are  put  in  a form  for  computer  evaluation  in  the  case  of  an  odd 
symmetric  quantizer  in  Sections  35  and  36. 


B-l 


B2.  PROBLEM  FORMULATION 


In  the  following  sections  a first  and  second  order  statistical 
analysis  of  the  A-D-A  system  shown  in  Figure  B1  is  presented.  Thi3  section  formulates 
the  problem  and  provides  many  of  the  required  definitions. 

Define  y(t)  to  be  the  desired  input  process  to  be  transmitted  through 
the  A-D-A  system.  Let  r(t)  be  the  input  dither  signal  which  is  statistically  indep- 
endent of  y(t)  and  define  x(t)  to  be  their  stun 

x(t)  = y(t)  + r(t)  (B-l) 

Let  z(t)  be  the  A-D-A  system  output  defined  almost  everywhere  by 

N 

z(t)  = Zn  Ig  [x(t)J  (B-2) 


where  N is  the  number  of  quantization  levels  and  the  output  levels  satisfy 
Zx  < Z2  <•••<  Zjj_^  < Zjj.  Ig  [•"]  is  the  indicator  function  for  the  set  S 


IS  W 


1 xCS 
0 X^S 


and  the  sets  S are  defined  by 
n * 

Sn  = ) 


n=l,2, • • -N 


(B-3) 


(B-4) 


where  the  transitions  I satisfy  < I.  <•••<!„.  < I„.  Also  define  the  sets 

n •'0  1 N-l  N 

E to  be 
n 


En  = (xi  xC[Tn-l 


n=l , 2 , • • • N 


(B-5) 


Define  s(t)  to  be  the  output  dither  process  statistically  independent  of  y(t)  and 
let  oj(t)  be  the  final  output. 


j(t)  = z(t)  - s(t) 


(B-6) 


Both  the  cases  where  the  dither  signals  are  statistically  independent  and  where  they 

are  identical  are  considered  in  the  following  sections. 

In  the  below  derivations  the  following  convensions  will  be  used.  For 

a process  u(t)  let  uq  denote  u(tn)  for  n=l  and  2.  The  probability  density  function 

(PDF)  for  u(t)  is  denoted  by  f (•)  and  the  associated  distribution  function  (DF)  by 

F (•)•  Assume  that  the  processes  y(t),  r(t),  and  s(t)  have  zero  means  and  the 
**  2 2 2 

variances  a , a , and  o , respectively.  Then  the  conditional  PDFs  for  x(t)  are 
r 3 


fx(x|y)  = fr(x-y) 


(B-7) 


fx^Xl>  x2[71,72>  ~ fr^Xl"7l,X2~72^ 


(B-8) 


so  that 


F (x|y)  = F (x-y) 
x r 


(3-9) 


Fx(x1,x2|y1,y2)  = F^atj-y^Xg-yg) 


(B-10) 


The  conditional  PDF  for  z(t)  is  given  by 


fz(z|y) 


* E iF*(i»l5r)  - Fx(v^>]  5<2-v 


= 5(2'Zn> 


(B-ll) 


N N 


f2(V  z2  1 71'  72}  = tFx(Tn’  Tm  1 71»  72} 


n=l  m=l 


- Fi(In-l>  \ 1 71>  72*  * W Vl  1 71’  72> 


+ F*(In-l'  Vl  1 71>  72>1  S(Z1  - V 5(22  - Zm> 


N N 


= Z Z fPr(In  - 71’  zn  ’ 72> 


n=l  m=l 


- Fr(Tn_1  - 71}  In  - 72)  - Fr(Tn  - 71?  - j^) 


+ Fr(In-l  - 71>  T.-l  - 72>]  5<zl  - V 6<22  ‘ V 


(B-12) 


where  5(*)  is  the  Dirac  delta  function?  Let  E{ • } denote  expected  value 


E(x} 


= J x f^(x)  dx 


(B-13) 


1 


and  P{a}  denote  the  probabilit7  of  event  a.  Finall7,  define  the  output  error  process 


e(t)  = 7(t)  - u(t) 


(B-l4) 


* See  equations  (2-43)  and  (2-44)  of:  J.  F.  Holland,  Statistical  Analysis  of 

Analog-Digital-Analog  Systems.  Ph.  D.  dissertation,  Stanford  Universit7,  March  1974. 
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and  its  mean  square  value 


a2  = E{e2(t) } 

q 


(B-15) 


in.  INDEPENDENT  DITHER  SIGNAL  CASE 

Equations  for  the  first  and  second  order  statistics  are  derived  in 
this  section  for  the  independent  dither  signal  case.  By  statistical  independence 
it  follows  from  (B-6)  that 


GO 

fw(oj|y)  = J fz(w  - z|y)  fs(-z)  dz 


N 

= Y lFr(Yn  - 7)  - Fr(Tn-l  “ y)l  fs('w  + V (B'l6) 
n=l 


and  similarly 


N N 


f>l>  “2  1 H-  y2>  = HH  tFr(In  " yl>  \ ' y2> 


n-1  m=l 


“ Fr^n-1  ” yl’  Ym  " 7 2*  ~ Fr^n  ” yl’  \-l  “ y2^ 


+ Fr(In-l  ' yl>  r»-l  - 72,1  + Zn’  - “2  * V 

CB-17) 


The  conditional  DF  for  the  error  is 


Fe(e|y)  = P{y  - w 4 e|y}  = P(s  4e  + z - y|z} 


B-5 


J 


N 

= y^P(s4e  + Zn  - j,  r + yljr) 

n=l 


N ^ e-y 

= Zl  IFr(In  ' 7)  - Fr(In-l  ' F>1  / 

n=l  r- 


f (s  + Z ) ds 
s n 


(B-l8) 


so  that  the  conditional  PDF  for  the  error  is 


fe(®l7)  = 2ZtFr(In  - F>  ' Wl  ' f)1  f3(e  + Zn  ‘ F> 

(B-19) 


n=l 


and  similarly 


fe(el»  e2  1 71’  72}  = 


N N 

2]lX(In  - Fl>  \ - F2> 

n=l  m=l 


- F (T  - y.  * T - y ) - F^(T  - y, , T , - yj 
r n-i  1 m 2 r n l m-i  2 


+ Fr(ln-1  - 71»  Tm-1  “ 72}1  fs{el  + Zn  “ yl’  e2  + Zm  " y2> 


(B-20) 


In  the  special  case  where  the  output  dither  signal  equals  zero  (B-19)  becomes 


N 


V'W  = 2 [Fr(In  ' y)  ' Fr(In-l  ‘ F>1  6(e  + Z»  ' 7> 

(B— 21) 


n=l 


B-6 


so  that 


N 

L 

n=l 


f (e)  = T - e - z ) - P (Y  . - e - Z )]  f (e  + Z ) 

e *■  r n n r n-l  n y n 

(B-22) 


Using  these  conditional  PDFs  the  conditional  first  and  second  order 
moments  can  be  evaluated. 

u (y)  = E{oj|y} 


Iy  00 

= Z fFr(In  - - Fr(In-l  ’ ?>1  f + V 

n=l 


doj 


N 


= Z Zn  lFr(In  * * Fr(In-l  ' F>1 


n=l 


(B-23) 


and 


E{(,1!y1,  y2>  = yu(y1) 


(B-24) 


Observe  that  (B-23)  reduces  to  (B-2)  in  the  limit  as  the  variance  of  the  input 
dither  signal  goes  to  zero. 

N 

^ = Ehh  !B'25) 


o -+0 

r 


n=l 


Similarly 


N 


E{u‘ 


!|7>  = Z Zn  Ipr(1n  ' * Fr(In-l  ' ^ + % (B-26) 


n=l 
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and 


EtwJ  | y1,  J2)  = E(w^  | y^} 

The  conditional  autocorrelation  function  for  the  output  w(t)  is 


(B-27) 


N N 

E<V  o)2  | 7l,  y2>  = 2 2 ZnZm  tFr(ln  “ 71*  Ym  " 72} 

n=l  a=l 

- Fr(In-l  - Fl’  T.  - 72>  - Fr(In  ' Fl>  Vl  ' ?2> 

^ss'W  <B-28) 

where  K (t,  , O is  the  autocorrelation  function  for  the  dither  process  s(t). 
ss  1’  2 

K3g(ti,  t2)  = Ets^)  s(t2)}  (B-29) 

The  equations  for  the  error  statistics  are 

N 

E(e(t) } = E{t7  - ZJ  [Fr(Tn  ’ y)  “ Fr(Tn-l  ' y)l } (B_30) 

n=l 


= Wfcr  - zj2  [Fr(Yn  - T)  - Fr(In.!  - T>1>  + 


n=l 


(B-31) 


WTd^)  e(t2)}  = £ E{7l  " Fr(ln-1  * y2)l} 

(B-32) 


n=l 
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K (t.,  t.)  =E(e(t.)  e(t  )} 
ee  l <d.  x 

N N 

= E EEl  [7l  • ^ [?2  - Zm]  [Fr(In  ' ?!>  Y»  ' Y2> 
n=l  m=l 


" Fr^Yn-l  “ 71’  Ym  “ 7 2)  ~ Fr^Yn  " 71’  Ym-1  " 72^ 

+ Fr^Yn-l  * 71*  Ym-1  “ y2^  + Kss^V  V (B-33) 

2 

which  reduce  to  the  appropriate  equations  in  the  limit  as  a goes  to  zero.  Observe 
that  the  effect  of  the  input  dither  is  to  randomize  the  transitions  Tq  similar  to 
the  effect  of  A/D  level  errors.  The  effect  of  the  output  dither  is  to  increase  the 
output  noise  by  a . 

B4.  IDENTICAL  DITHER  SIGNAL  CASE 

Equations  for  the  first  and  second  order  statistics  are  derived  in 
this  section  for  the  identical  dither  signal  case  where 

s(t)  = r(t)  (B-34) 

v’ 

The  conditional  DF  for  the  output  io(t)  is 

F (<o|y)  = P{z  - r 4 w|y}  = P{r^z  - w|y} 

H 

= E P(r  - Zn  ' r + 7ClTn-l’  V ' 

n=l 


N » 


= ^ ^ J fr(r)  Ig  (r  + y)  dr 
n=l  Z -<d  n 


B-9 


r 


= E / £r(r  + Z»>  \ (r  * r) 


n=l  — jj 


so  the  conditional  PDF  for  oj(t)  is 


fw(w|y)  = fp(-«  + Zn)  IE  (-w  + 7) 


n=l 


arri  similarly 


N N 

f>l’  "2  1 7r  V = 2 12  fr(""l  + V 

n=l  m=l 


~^2  + 


• h ('“l  + 71]  XE  (-<1)2  + 7 2} 

n m 

The  conditional  DF  for  the  error  e(t)  is 


F (e|y)  = P{y  - w 4 e|y}  = P(r4e  + 2 - y|y} 
@ 


a 

= ^P(r4e  + Zn  - y,  r + 7c[\_v  In)l7> 
n=l 


N e+Z  -y 
- n 


f fr(r)  Ig  (r  + y)  dr 
n=l  ^ 


N e-y 


2 /"  fr(r  + Zn}  h (r  + 7) 

“ i 11 


(B-35) 


(3-36) 


(3-37) 


'B-39) 
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so  the  conditional  PDF  for  e(t)  is 


f.<eW  = E fr(<  - 7 + V TE  <8> 


n=l 


(3-39) 


and  similarly 


N N 

fe(V  *2  I *!>  'a1  = E E fr<«l  - + zn-  e2  ' ^ + V 

n=l  m=l 


<81>  h <82> 

m 


( B-40 ) 


Using  these  conditional  PDFs  the  conditional  first  and  second  order 
moments  can  be  evaluated . 


Uu(y)  = E{w|y}  = 


N Z -T  , 

e r 

n=l  Z -I  4y 
n n J 


+7 

co  £ ( — oj  + Z ) doj 

r n 


-E 

^—1 


zn  [fr(In  - 7)  - 


(B-41) 


N 


E{w‘ 


:|7>  * E zl  IFr(In  - - Fr(In-l  ‘ ?>]  + “ 


n=l 


N I -y 

' 2 S Zn  f x fr(x)  **  (3-42) 

n=l  *T  , -y 
n-1  ^ 


B-ll 


A comparison  of  these  equations  with  (B-23)  and  (B-26)  shows  that  y (y)  is  the 

(jO 

same  but  in  the  case  of  identical  dither  the  second  moment  has  the  additional  term 
given  in  (B-42) . The  conditional  autocorrelation  function  for  the  output  is 


N N 

E(“i  “2 1 z-  ' yi-  Y» ' ya) 

n=l  m=l 


" Fr^Yn-l  ~ 71’  Ym  “ 72^  “ VYn  ' 7V  Ym-1  “ y2) 


+ Fr(Yn-l  - 71»  Ym-1  " 72}1  + Krr(V  t2) 


N 


V71 


- Tin  f E{x2  I xl}  fr(xl}  ^1 

...  _ i *S-vr  


n=l  I , -y, 
n-1  1 


\ \ rm  72 
- 2jm  7 E{X1  1 X2}  fr{x2} 


( B— 43) 


m-1  Ym-1"72 


which  may  be  compared  with  (B-28) . The  conditional  mements  of  the  error  are 


N « 

E{e|y}  = ^ ^ / e fr(e  - y + Zq)  IE  (e)  de 

n=l  -■»  n 


N 


= f [x  + 7-zJ  fr(x)  Ig  (x  + y)  dx 

.An 


n=± 


i * 
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N 

= 2>  - y [VTn  - y>  - 'r(y  - r>]  (B-W) 

n=l 

N 

Me2|7)  = £[jr  - Znf  [Pp(ln  - 7)  - Fr(Yn_1  - y)]  + o2 

n=l 

H Yn-y 

- 2 ^2  zn  f x frW  ( B— 45 ) 

n=1  \l-7 

which  may  be  compared  with  (B-30)  and  (B-31).  Similarly, 

N 

£<y(V  .(t2»  = Yu  E(yl  ly2  - Zn]  [pr(1n  ‘ y2>  ' Fr(Yn-l  ' y2>]  I 
n=l 


(B-46) 


N N 


Etel  e2  I yl’  y2>  = ZEtyl-2n][y2-Z»][Fr(Vyl-  Vy2> 


n=l  m=l 


* MYn  1 
r n-i 

“ 71’  Ym 

+ 1 
r n-i 

- Yl’  Ym- 

N 

J -y  1 

-2X 

/•  n i. 

/ E{x; 

n=l 

1 ,-y, 

n-1  rfl 
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n y. 

-IX/ 

•'T T 


Jnfy2 

/ S{xl 
Ym-l“72 


x2}  fr^X2^  x2 


(B-47) 


which  may  be  compared  with  (B— 33) * Thus,  the  first  moments  are  the  same  for  the 
independent  and  identical  dither  cases  but  the  second  moments  differ  by  terms 
which  tend  to  reduce  the  noise  power  in  the  identical  dither  signal  case. 

B5.  FORMULAS  FOR  THE  INDEPENDENT  DITHER  CASE 

Formulas  are  given  in  this  section  for  the  independent  dither  case. 
They  are  worked  out  explicitly  for  Gaussian  amplitude  statistics.  It  is  assumed 
that  the  output  dither  signal  equals  zero. 

A comparison  of  equation  (B-26)  and  (A-6)  shows  that  the  independent 
dither  case  is  a generalization  of  the  formulas  given  in  Appendix  A for  odd  symmetric 
quantizers  satisfying  (A-2)  and  (A-3).  Define  the  functions: 


GO 

Fq (y/a)  = f fy(x)  Fr(y  - x)  dx 

— OO 

00 

F^y/a)  = -J-  J x fy(x)  Fr(y  - x)  dx 


(3-48) 


(B-49) 


Observe  that  in  the  limit  as  a ■ goes  to  zero  the  distribution  function  Fr(y  - x) 
becomes  a unit  step  function  and  these  equations  reduce  to  (A-7)  and  (A-8).  Thus, 
(B-48)  and  (B-49)  are  just  a generalization  and  the  same  basic  formulas  given  in 
Appendix  A can  be  used  to  evaluate  performance  in  the  presence  of  dither. 

As  an  example  suppose  y(t)  and  r(t)  are  Gaussian  processes  so  that 


F (x)  = -J-  [1  + erfU/vT^a  )] 


( B— 50) 


I 


Then* 


where 


Similarly 


f (x)  = -=^-  exp(-x2/2c2) 

7 Vi?  o 


(3-51) 


>(7/0) l'11  (vfr) 

= -J”  + / erf  (x)  exp  j-  JVx  - 


fevTTf)- 


p ? 

-x  /2a  dx 


1 + erf 


(3-52) 


= v° 


(B-53) 


oo 

F1(y/a)  = f x erf  / \ 

1 aVi?1  a2  i W?  *r  ) 


-x2/2a2  . 
e ' dx 


(3-54) 


Define  the  functions 


gi(x)  = erf  (vfr) 


(B— 55) 


* "A  Table  Of  Integrals  Of  The  Error  Function,"  E.  Ng  and  M.  Seller,  Journal  Of 

Research  of  the  National  Bureau  of  Standards  - B.  Mathematical  Sciences,  Vol.  73B, 
No.  1,  January  - March  1969 . 


e2U)  = 


x -x2/2 a2 

= — x e ' 


(B-56) 


where  prime  denotes  differentiation.  Then 


.o 

F]_(y/a)  = gx(x)  g2(x)  - / 

_oo  *ico 


g1(x)  g2(x)  dx 


( B— 57 ) 


where 


" / v 2 -(x-v)2/2 a2 

gi<x)--v^r  e 


o P 

, » 1 -x  /2a 

g2(x)  = - e ' 

2 


( B— 58) 


(B-59) 


and  after  some  manipulation  the  result  is 


F-Jy/a)  = - 


2o2  [32+l], 


(B-60) 


In  the  limit  as  ar  goes  to  zero  these  formulas  reduce  to  (A-l4)  end  (A-15)  as 
expected.  Also  note  that 


■f 


in  the  formulas  given  in  Appendix  A for  Y^  and  Zq. 


(B-61) 
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B6.  formulas  for  the  identical  DITHER  CASS 


Formulas  are  given  in  this  section  for  the  identical  dither  case  and 
are  worked  out  explicitly  for  Gaussian  inputs  and  dithers.  From  (B-39)  the  PDF  for 
the  error  e(t)  is 


f (e) 
e 


XX  « / 

n=l  n J* 


f (e  - y + Z ) f (y)  dy 
r n 7 


ZI-.  (e)  f (e  + Z ) 

E x n 

T1 


(B-62) 


where  x(t)  is  defined  by  (B-l).  Then 


N r> 


>« 

2/ 


e f (e  + Zj  L,  (e)  de 
x n E 

n 


N Y 


= V f°  [x  - Zj  2 f^x)  dx 
n=l  A , 


(3-63) 


which  is  the  same  formula  a3  (A-6)  so  that  again  the  formulas  given  in  Appendix  A 
can  be  used  to  evaluate  the  dither  case. 

As  an  example  suppose  y(t)  and  r(t)  have  Gaussian  amplitude 
statistics.  Then  their  sum  x(t)  is  Gaussian  with  variance 


2 2 , 2 2 r .2  , , i 

= a + ap  = a [3  + lj 


(B-64) 


so  it  follows  that 


h2  ♦ i] 


(B-65) 


J 


